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[57] ABSTRACT 

A read unit 400 which governs reading of data and a write 
unit 500 which governs writing of data are located sepa- 
rately in a RAID unit 300 which controls array type mag- 
netic disk units. To read data from magnetic disk units 800, 
a control circuit 600 uses the read unit 400 to read data 
through an HDD control unit 700. lb write data, the control 
circuit 600 uses the write unit 500 to write data into the 
magnetic disk units 800. Since the read unit and write unit 
are provided separately, processing performance improves. 
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[57] ABSTRACT 

Apparatus for raaintaming duplicate copies of informa- 
tion stored tn fault-toleraoi computer main memories is 
disclosed. A non write-through cache memory associ- 
ated with each of the system's processing elements 
stores computations generated by that processing ele- 
ment. At a context switch, the stored information is 
sequentially wrincn to two separate main memory units. 
A separate status area in main memory is updated by the 
processing element both before and after each writing 
operation so that a fault occurring during data process* 
ing or during any storage operation leaves the system 
with suflicient information to be able to reconstruct the 
data without loss of integrity. 

To efliciently transfer information between the cache 
memory and the system main memoiies without con- 
suming a large amount of processing time at context 
switches, a block status memory associated with the 
cache memory contains an entry for each data block in 
the cache memory. The entry indicates whether the 
corresponding data block has been modified during data 
processing or written with computatioaa] dau from the 
processing clement. The storage operations are carried 
out by high-speed hardware which stores only the mod- 
ified data blocks. Additional special-purpose hardware 
simultaneously invalidates all cache memory entries so 
that a new task can be loaded and started. 

5 Claims, 9 Driwiig FIgnrei 
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the invention in which all data modified under control 

MEMORY BAOC'UP SYSTEM of a program is temporarily stored only in a non write- 

through cache memory associated with the processor 
This application is a continuation, of application Ser. that is running the program. When a context switch or 
No. 448,419, filed 12/9/82. now abandoned. 5 an overflow situation in which the cache memory be- 

FIELD OF THE INVENTION comes full makes it necessary to write the modified data 

into the system main memory, a special data location in 
This invention relates to fault-tolerant computers in the main memory, containing among other things the 
general and, in particular, to memory backup systems identity of the user program currently being executed, is 
for fault-tolerant computers. lo updated to indicate that the data in the cache memory is 

BACKGROUND OF THE INVENTION J*^"" to a first area in main memory associated 

witn tne program. 

Many computer systems are designed to be "fault-tol- Spectal circuitry in the processor then writes all of 
erant". Typically, these systems can experience one or the data which has been modified by the user's program 
more temporary or permanent circuit failures and con- 13 to the first area. At the end of the storage operation, the 
tinue to function without loss of data or without intro- status block in the main memory is agam updated to 
ducing serious errors into the daU. Such systems typi- indicate that the first memory area has been updated 
cally vary as to how many faults can be "tolerated" and and that a second area is about to be updated. Subse- 
as to how each fault is handled. quently. the same data is written to the second area. The 

In order to be fully fault-tolerant, a computer must be 20 second storage operation is followed by a final modifi- 
able to survive a fault which renders one or more per- cation of the sutus block to indicate that the update of 
tions of its main memory inoperative. In such a situa- the second area has also been completed, 
tion, to avoid losing or corrupting data, it is necessary to Therefore, no matter when a fault occurs there re- 
have a second, or backup copy, of the data available in maim a consistent set of data in main memory and an 
a separate memory location which cannot be disabled 25 associated address at which each user program can be 
by the original fault Therefore, in fault-tolerant systems reinitiated For example, if a processing element fails 
it is common to have at least two main memory units before it first begins writing modified data blocks to the 
and to maintain a copy of the system data simulta- first memory area, the data and starting address in the 
neously in both units. first memory area are exactly what they were before the 

However, maintaining a duplicate copy of data in 30 processing element began executing the program and 
two separate memories causes a significant reduction in the program can be restarted using the initial data in the 
the computational speed of the computer since every first memory area. 

data storage operation must be performed twice and Alternatively, if the processing element fails after the 
such operations arc usually supervised by the process- writing operation to the first area begins, but before it is 
ing element which cannot simultaneously perform nor- 35 completed, the status block in main memory iftdirptw 
mal processing operations. that the writing operation has not been completed and a 

In order to reduce the time penalty associated with fault recovery routine need only write the contents of 
maintaining duplicate data copies, some prior art fault- the program's second area in main memory into its first 
tolerant systems maintain only one copy of the dau area and cause reexecution of the program on another 
during normal processing operations and, at periodic 40 processing element Similarly, the computer system can 
intervals, update a data copy maintained in a backup recover from a fault which occurs during modification 
memory. This scheme works satisfactorily unless a fault of the program's second area in main memory by assign- 
occurs in the main memory which disables portions that ing a new second area to the program and recopying the 
contain data which has not yet been copied or unless a contents of the program's first area into the new second 
fault occurs during the copying operation itself which 45 area. 

disables either the main memory or the copy mentory so In accordance with the invention, the first and second 
that the copy cannot be completed — such failures can memory areas are located in physically separate mem- 
cause loss of data integrity. ory elements, therefore, a single memory dement iafl- 
It is an object of the present invention to provide a ure leaves at least one consistent copy of the program 
memory backup system in which no single failure can SO data m main memory except when the copks are being 
cause a loss of data or data integrity. updated. In this case, the system can recover by corn- 
It b another object of the present invention to pro- pleting the updating of data in either or both memory 
vide a memory backup system in which backup can be areas. 

carried out quickly and efRdently during a context In order to provide reasonable efficiency during pro- 
switch. S3 gram operation while storing all dau modified by the 

It is yet another object of the present invention to program in an •wv^p^f^ cache memory, the cache 
provide a memory backup system in which data copy- memory must be much larger then that typically used in 
ing can be carried out without consuming large prior art system. Such a large cache memory can im- 
amounts of processing time thereby slowing processing pose significant time penalties during a context switch 
^pccd. 60 because in accordance with normal cache operation. 

It is a further object of the present invention to pro- each data entry in the cache must be written to the 
vide a memory backup system in which the required system main memory before a new user program can be 
circuitry to provide complete backup capabilities is installed. 

minimized. In order to decrease the time required to write the 

SUMMARY OF THE INVENTION " "^^^ * «I»nite 

block status memory is iwtonatcd with each cache 
The foregoing objects are achieved and the foregoing memory. The block status memory contains status 
problems are solved in one illustrative embodiment of entries corresponding to each data block in the assod- 
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Bled cache memory. Whenever information is written 
to a data block from a location other than main mem- 
ory, the associated status entry b modified thus identify- 
ing information which has been changed during pro- 
gram operation. Special-purpose hardware is also pro- 
vided which allows the processing element to write to 
the system main memory only those data blocks which 
have been modified and which also have addresses 
within any specified address range thereby greatly re- 
ducing the amount of time required to effect a context 
switch. 

In addition, to further facilitate context switches, 
special purpose hardware is provided in the processing 
element that can be activated in parallel with other 
processing operations and which can be used to invali- 
date virtual memory address translation map entries 
during a context switch. Therefore, the supervisor pro- 
gram tn the processing dement need only issue a com- 
mand to start the invalidation opetaticm and then pro- 
ceed to other functions. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of an illustrative computer 
system in which the present invention may be utilized. ^ 

FIG. 2 is an expanded block diagram of the process- 
ing element shown in FIG. 1 incorporating the illustra- 
tive cache and block status memories. 

FIG. 3 of the drawing shows an expanded block 
diagram of the slave interface shown in FIG. 1. 

FIG. 4 of the drawing shows an expanded block 
diagram of the memory element shown in FIG. 1. 

FIG. 5 of the drawing shows the division of the cache 
memory into supervisor and user code and data ^»oes 



Up to sixty-four processing elements (PEs) may be 
added to the illustrative system of which only three 
processing elements, 100, 105 and 110. are shown for 
clarity. Each PE is identical and contains a processor 
that is a conventional data processing device capable of 
executing both user application programs and supervi- 
sor programs which control and coordinate the opera- 
tion of the associated processor. 

In accordance with the invention, each PE also con- 
tains a cache memory that temporarily stores both user 
and uipervisor program code and data. As is typical, the 
cache memory is used to reduce the effective memory 
access time. However, as will be explained in more 
detail below, the cache memory is also used b conjunc- 
tion with the memory elements to provide a fault-toler- 
ant data backup mechanism which both insures data 
integrity for any single fault and provides high speed 
operation. 

Also included in each PE is a read-only memory in 
^ which is stored additional frequently-used supervisor 
code and a bootstrap loading program which enables 
the processing element to become operational when it is 
reset or upon power-up. 

The iUustrative computer system also utilizes a vir- 
tual memory system in which the address information 
produced by the processors are translated before being 
provided to the main memory elements. A table of 
translations <a map) for translating virtual addresses into 
physical addresses which are used by the main memory 
elements is stored in a random-access memory located 
in each processing element 

All processing dements are coimected to redundant 
processor buses, such as buses 115-116, which are dupli- 



30 



and the mapping of the supervisor code and supervisor 33 cated for reliability purposes and increased throughput 



dau spaces into their respective locations in the cache 
memory. 

FIG. 6 of the drawing shows the mapping of the user 
data and user code spaces into their respective locations 
in the cache memory. 40 

FIG. 7 of the drawing, consisting of two drawing 
sheets, shows a detailed block diagram of circuitry used 
to operate the cache and block status memories in the 
processing dement 

FIG. 8 of the drawing shows an expanded block 43 
diagram of the memory management circuitry in the 
illustrative embodiment 

FIG. 9 of the drawing, consisting of three drawing 
sheets, shows the arrangement of informatioD on each 



Access to buses llS and 116 and the system buses 130 
and 131 by the PEs b controlled by master mterface 
units 120 and 125, respectively, which are duplicated 
for reliability and throughput purposes. Each master 
interface unit contains sequence and control logic and 
bus artntration circuitry which can handle up to sixteen 
processing dements. In order to accommodate addi- 
tional processing elements, additional processor bus and 
master interface unit pain may be added to system buses 
130 and 131. Up to a total of four processor bus pairs 
may be induded to the iUustrative system to accommo- 
date sixty-four processing dements. 

If there are more than 16 processing elements in a 
particular computer configuration, the processing de- 



of the internal buses during the various internal opera- 50 ments are divided into groups of up to sixteen process- 
tions. ing elements. Each group of up to 16 processing de- 

ments b connected to a common processor bus, which 
is, in turn, connected by dedicated master interface units 
to the system buses. 

Within each group of up to sixteen processing ele- 
ments, siq>ervtsory control is shared among the proces- 
soiB. In particular, at any one time a supervisory or 
"executive" processing dement is recognized by all the 
processing dements in oat groiqj and the executive role 
60 p asses from processing dement to piocfssing demen t in 
a well-defined priority scheme. The exact mechanism of 
the transfer of control among processon is disc lo sed in 
detail in a copokding patent plication entitled 'Modu- 
lar Computer System" by Jack J. Stiiller et al. and filed 



DETAILED DESCRIPTION 

As shown in FIG. 1, an illustrative fault-tolerant 
computer system is comprised of three main de ment s; 53 
processing dements, memory elements and peripherd 
dements. All of the dements are connected to common 
system buses 130 and 131. Only one system bus is neces- 
sary for system operation, but two buses are preferred 
to prevent a malfunction in one bus from stopping oper- 
ation of the entire system and to increase tlut>ugl^)ut of 
the system. Similarly, for reliability and tpooii purposes, 
the interface units which connect the processing, mem- 
ory and peripheral dements to the system bus are dso 



duplicated. Buses 130 and 131, dtbough shown as a 63 in the United States Patent and Trademait Office on 



single line, are actudly multi-wire buses comprising 
many separate data and signd lines as will be described 
further herein. 



Sept 3, 1982 and assigned Ser. Na 414,961, now U.S. 
Pat No. 4,484^73, which disclosure is berdiy incorpo- 
rated by reference. 
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All system modules (including memory elements and bufTering for infonnation passing between the process- 
peripheral units) arc assigned uniquely to one process- ing demente and the pertpheral controllers and units, 
ing element group, however, all processing dements The formatting functions performed by the peripheral 
can communicate with all memory dements and bus bus ad^tor units hdp to speed up overall pTYXxssing 
adapters, even those "bdooging" to another group. In 5 time by rdicving the processing dements (PEs) of some 
addition, some common areas in system main memory routine data transfer tasks. Each peripheral bus adaptor 
are recognized by all processing element groups. can be individually programmed to provide an interface 
Within each processing element group, system re- to a variety of standard peripberal buses onto which in 
sources are allocated by the executive processing de- the illustrative cmobodiment can be attached input/out- 
ment as if that group where the only group in the com- 10 put controllers of various types, including secondary 
puter system. Communication between groups is ac- storage devices such as disks and tapes. Peripheral bus 
complished by means of the common memory areas adaptors 190-192 can be programmed to convert be- 
which contain hardware "locks" to facilitate such trans- tween the signals used on intemal memory buses 155 
^'crs. and 156 and the signals used to the peripheral buses 

System buses 130 and 131 are connected to memory 15 196-198 and. therefore, allow many difTerent peripherd 
dements 165-175 and bus adapters 184-186 by means of bus formats to be used with the illustrative system, 
slave interfaces 155, 140 and 145, 150, respectively. When a memory element or bus adaptor is inserted 
Each slave interface is identtcd and has a redundant into the sy^em, it undergoes an initial power-up clear 
duplicate for reliability purposes and to increase system and initialization cycle during which dl of its bus driv- 
throughput More particularly, one slave interface in a 20 ers are turned off to prevent the unit from communicat- 
pair can be used to provide an access path for transfer of ing erroneous information to the system. In addition, 
data to or from one memory dement or bus adaptor in the unit's intemd status registers axe set to a predeter- 
the associated group while the other slave interface mined state. Afkcr initialization has been completed the 
simultaneously provides an access path to a second unit sends an intemipt to the current executive process- 
memory dement or bus adapter. Slave interfaces 25 big dement thereby informing the executive processing 
135-150 contain circuitry which converts the signals dement that it is available. 

produced by memory elements 165-175 and the periph- In response to this interrupt, the executive processor 
eraJ buses 196-197 (via peripherd bus adapters 190-192 initializes the newly inserted unit by testing the unit to 
and bus adapters 184-186) into signals which are com- verify that its intenul fault monitoring apparatus is 
patible with the signds used on system buses 130 and 30 operationd and records its existence in appropriate 
131. memory tables. 

In particular, slave interfaces 135 and 140 connect If the unit is a memory dement (determined by read- 
system buses 130 and 131 to memory buses 160 and 161. ing its status) it is assigned a physicd name, thus defin- 
Although only two memory bus pairs. 160. 161 and ing the physicd addresses to which it b to respond. 
155,156. are shown for clarity, up to sixteen dud-redun- 35 Alternatively, if the unit is a bus adapter/peripberd bus 
dant memory bus pairs may be added to the illustrative adapter, a program is loaded into its intemd program 
system. memory which program diows its intemd micro- 

Memory buses 160 and 161 are. in turn, connected to processor to query the associated peripherd devices in 
a plurdity of memory dements and bus adapters of order to determine the number and type of peripherd 
which three devices (memory dements 165. 170 and bus 40 uniu on the associated peripherd bus. Peripherd infor- 
adapter 185) are shown. These elements together consti- mation is reported back to the executive processing 
tute the main memory of the system. In the illustrative dement via the interrupt mechanism which thereupon 
embodiment, each of the memory elements contains 2^1 responds by loading the appropriate operating pro- 
bytes of random access memory and consists of a con- grams into the program memory in the newly niserted 
ventiond random access memory unit Other well- 45 unit and again updating system configuration cables m 
known memory units of different sizes may also be used memory. 

in a well-known manner. A more detailed iuoctiond block diagram of a pro- 

Slave interfaces 145 and ISO connect system buses cessing dement is shown in FIG. 2. Each prtxxssing 
130 and 131 to memory buses 155 and 156 which arc element contains tdenticd dicuitry and therefore the 
identicd to buses 160 and 161. Peripherd buses 196 and 50 circuitry in only one processing element will be dis- 
198 are coupled to buses 155 and 156 by interface cir- cussed in detail to avoid unnecessary repetition. The 
cuitry consisting ofbus adaptors of which two fldaptoxB. heart of the processing dement b a microprocessor unit 
184 and 186, are shown and peripherd bus adapters of (MPU) 210 which performs most of the ordinary calcu- 
which units 190 and 192 are shown. Each bus adaptor lations handled by the computer system. Microprxices- 
coiitains buffer memories and data processing logic 55 sor uiut 210 may tUustrativdy be a convaitiond 16-bit 
which can buffer and format data information recdved miCTOprocessor. Severd microprocessor units with suit- 
over the memory buses and the peripherd buses and able characteristics are available commerically: a unit 
commands received from the prooessmg dements via suitable for use with the illnstrative embodmteot is a 
the system buses. In particular, each bus adaptor can modd MC68000 microprocessor available from the 
handle signals on two mdependent command channek 60 Motorola Semiconductor Products Company. Phoenix, 
and two independent input/ou^ut data and command Ariz. 

channels. Supporting the operation of MPU 210 are aeverd 

Each bus adaptor, such as adaptor 184. b connected other units which asant the MPU to decrease its pro- 
to a peripherd bus adaptor 190 over a dedicated bus. cessing time and decrease the effective memory access 
The peripherd bus adapters contain a microprocessor 65 time. In particular, these units indnde memory manage- 
and an associated program memory. Under control of a ment unit 200, ROM 205 and cache memory 250. 
program stored in the program memory, the micro- In particdar, MPU 210 operates with a *Virtud ad- 
processor unit can perform format conversions and dress** arrangement In thb wdl-known memory ar- 
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rangement. MPU 210 produces "virtual" addresses 
which require a translation in order to convert them 
into the actual addresses which correqxmd to memory 
locations in the computer system main memory. The 
translation of virtual addresses to physical addresses is 5 
accomplished by memory management unit 200. Unit 
200 utilizes a translation **tab!c" or "map" retrieved 
from main memory during a context switch and stored 
in an internal random access memory to perform the 
translation from virtual to physical addresses. SpedH- '0 
cally, virtual address information produced by MPU 
210 is provided to memory management unit 200 via 
local address bus 220. Memory management unit 200 
translates the virtual address information into physical 
addresses used for addressing the main memory in the 
computer system. The translated information is pro- 
vided to cache/local bus adapter 230 which controls the 
flow of information inside the processing dement and 
gates the appropriate translated cache address onto ^ 
cache data bus 285. 

During a context switch the entries in the translation 
map must be invalidated to prevent improper operation. 
In accordance with one aspect of the invention, to de- 
crease the time required to perform a context switch, 
special purpose hardware is provided in the processing 
element which can be activated in parallel with other 
processing operations. The special purpose hardware 
automatically invalidates all map entries during a con- 
text switch. Therefore, the supervisor program in the 
processing element need only issue a command to start 
the invalidation operation suid then proceed to other 
functions. 

Cache memory 250 is a well-known memory element 
which is used to decrease the cflective memory access 3; 
time and, in accordance with the invention, to provide 
a memory backup arrangement. In particular, a Bub^ 
of the information stored in the main memory is also 
temporarily stored in cache memory 250. Memory 250 
responds directly to virtual addresses supplied by mi- 40 
croproccssor unit 210 and, if the requested information 
is present in the cache memory (called a "cache hit")i 
the infonnation becomes available in « much shorter 
time interval than a normal access to main system mem- 
ory would require. If the requested infonnation is not 45 
present in the cache memory but is present in main 
memory, the attempted access b called a "cache miss" 
and weU-known circuitry automatically transfers or 
"writes" a parcel of infonnation caUed a "block" con* 
ta ifing the requested infonnatif» firom main memory so 
into the cache memory. If the requested information b 
located only in peripheral secondary storage the access 
attempt results in a "page fault" which b handled via 
procedures to be hereinafter described. 

Cache memory 250 consbts of a 2'^ byte raiulom 35 
access memory arranged in a 36 bit by 32.000 word 
(actually 32 X 1024 word) configuration (each 36-bit 
word contains 4 infonnation bytes each associated with 
a parity bit). Infonnation retrieved from cache memory 
250 is provided, via cache data bus 285 and cache/local 60 
bus adapter 230 to local data bus 225 and thence to 
MPU 210. Cache/local bus adapter 230 provides inter- 
face and signal conversion circuitry between 32-infor- 
mation-bit cache bus 285 and 16-information<bit local 
dau bus 225. In addition, bus adapter 230 checks byte 65 
parity on data passing from cache memory 250 to local 
bus 225 and generates byte parity nifonnation for data 
flowing in the opposite direction. 
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In accordance with the invention cache memory 250 
b a non-write through cache memory. Most conven- 
tional cache memories are write-through memories; 
that is, when infonnation is written into a conventional 
cache memory, the same information is also immedi- 
ately written into the copy of the data maintained in the 
system main memory. Write-through operation allows a 
consistent copy of data to be maintained in one location. 
Unfortunately, if a fault occurs before processing b 
finbhed. the only data copy may have become noodified 
during processing so that it is impossible to restart pro- 
cessing on the original data. Contrary to conventional 
operation, the inventive cache memory b non write- 
through so that modified data b written only in the 
cache memory during processing. Therefore, if a fault 
occurs during processing, the original data in main 
memory remains intact so that processing can be re- 
started on the original data. 

In particular, v^en a context switch or an overflow 
situation in which cache manory 250 becomes full 
makes it necessary to write the modified data into the 
system main memory, a special data location in the main 
memory, containing among other things the identity of 
the user program currently being executed, b updated 
to indicate that the data in cache memory 250 b being 
written into a first area in main memory associated with 
the program. 

Special circuitry, which will hereinafter be described 
in detail, in the processing element then writes all of the 
data in cache memory 250 which has been modified by 
the user's program to the first area. At the end of the 
writing operation, the status block in the main memory 
b again updated to faidicate that the first memory area 
has been updated and that a second area b about to be 
updated. Subsequently, the same data b written into the 
second area. The second storage operation b followed 
by a final modification of the status block to indicate 
that the update of the second area has also been com- 
pleted. 

Therefore, no matter when a fault occurs there re- 
mains a consbtent set of data in main memory and an 
associated address at which each user program can be 
reinitiated. For example, if a processing dement faik 
before it fim begins writing modified data blocks to the 
first memory area, the data and starting address in the 
first memory area are exactly what they were before the 
processing dement began executing the program and 
the data processing task can be restarted usmg the initial 
data in the first memory area. 

Altemativdy, if the processing dement faib before 
the writing operation to the flzst area b complete, the 
status block in main memory indicates that the writing 
operation has not been completed and « fault recovery 
routine need only write the contents of the program's 
second area in main memory into its first area and cause 
reexecution of the program on another processing de- 
ment. Similariy. the computer system can recover from 
a fault which occurs during mod ifi ca ti on of the pro- 
gram's second area in main memofy by awignin g a new 
second area to the program and leoopying the contents 
of the program's first area into the new second area. 

In accordance with the invention, the first and second 
main memory areas are located in physically separate 
memory dements, therefore, a single memory dement 
failure leaves at least one consistent copy of the pro- 
gram data in main memory except when the copies are 
being updated. In thb case, the system can recover as 
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described above by completing the updating of data in trol signals and coordinating the transfer of data be- 
dther or both memory areas. twecn cache mcnxtry 250 and the pTxx:essor bus. 

In order to provide reasonable efTtciency during pro- Read-only memory 205 is also connected to the local 
gram operation while storing ail data modified by the address and data buses 220 and 225, re^xt^ively, and 
program in an associated cache memory, the cache 5 contains program instructions that can be tw rrrs isf d by 
memory must be much larger then that typically used in MPU 210. In particular. ROM 205 contains a "boot- 
prior art system. Such a large cache memory can im- strap" program which is used to restart the processing 
pose significant time penalties during a context switch element after initial system power-on or after a system 
because in accordance with normal cache operation, reset. In order to increase the processing speed of MPU 
each data entry in the cache must be stored in the sys- 10 210. ROM 205 also contains other frequently-used oper- 
tem main memory before a new user program can be ating system routines which may be accessed by MPU 
installed. 210 over local data bus 22S. 

In accordance with another aspect of the invention, In addition to receiving and transmitting data signals 
special purpose circuitry is also provided which stores via bus 280, interfaces 265 and 270 may also receive 
only those data entries in cache memory 250 which 13 interrupt signab and gate them onto over 19-bit inter- 
have been modified during program operation. nipt bus 275. Incoming interrupt signab are provided to 

More particularly, associated with cache memory 250 interrupt network 235 which gates the interrupt data 
is block sutus memory 255. Memory 255 contains a received over interrupt bus 275 onto local data bus 225 
plurality of entries, each of which contains information where the dau can be read by MPU 210. Interrupt data 
regarding one block (I2S-byte segment) of data stored 20 received over interrupt bus 275 consists of an 8-bit iden- 
in cache memory 250. Specifically, each entry in block tification code indicating the source of the interrupt, a 
status memory 255 contains a "label" which identirtes 3-bit level code indicating the level of the interrupt and 
the vinual address, if any, currently mapped into the a 4-bit interrupt vector which indicates the memory 
associated cache block (virtual address information is location at which the desired interrupt routine begins, 
received from cache address bus 251). In addition, each 25 In addition. 4 parity bits are included to detect errors in 
entry in block status memory 255 contains a "valid" bit the remaining IS information bits on the 19-bit interrupt 
which indicates whether the contents of the associated bus. 

block are valid in the present context (associated with FIG. 3 shows a functional block diagram of the slave 
the program presently running in MPU 210) and, each interface unit of the illustrative fault-tolerant computer 
entry also contains a "dirty" bit which indicates 30 system. The slave unit is connected to the system bus by 
whether the contents of the associated block, if valid. bus interface 310 and to the associated memory bus by 
have been altered since the contents were initially bus interface 315. System bus interface 310 provides 
loaded into the associated cache memory block. filtering and buffering for S6 addresa/dau lines and 

In accordance with another aspect of the invention, associated control lines and 14 interrupt lines, 
the valid and dirty bits stored in block status memory 33 Similarly, memory bus interface 315 provides filter- 
255 arc used by special circuitry which, upon a context ing and buffering for 10 interrupt lines (consisting of 2 
switch, stores to main memory the contents of only interrupt level bits, 4 interrupt source identification 
those blocks identified as "dirty" by the block status code bits and 4 parity bits) and 26 address/data lines (32 
inemory. thereby efrecting a savings in the amount of information bits and 4 byte parity bits) and some assod- 
time necessary to perform a context switch. Block sta- 40 ated control lines for transferring information from the 
tus memory 255 may also be used for controlling the slave interface to the monory bus and ultimately to the 
automatic clearing of cache memory 250 during context memory elements or bus adapter imits. Information on 
switches. 36-bit internal data bus 340 is provided to a parity cir- 

Cache memory 250 may receive address information cuit checker 320 which checks byte parity on received 
over cache address bus 251 and data information, via 4S addresses and data. Information is also provided to 
bus interfaces 265 and 270, from the processor buses in command/status logic 325 which decodes incoming 
order to update information in memory 250 from the information and recognizes selected commands t h at are 
system main memories. More specifically, interfaces 265 uaed for diagnostic purposes and stores status condt- 
and 270 connect the processing element to the proces- tions that are used to indicate failux« coaditions to the 
sor buses and each accommodate 19 intcmqjt lines Qn- 30 processing elements. 

eluding IS information bits and 4 parity bits) and 36 The 10 interrupt lines which pass through memory 
address/data lines (which consist of 32 information bit bus intei&ce 315 and the 14 interrupt lines which pass 
lines and 4 parity bits). Miscellaneous control lines (not through system bus mterface 310 are provided to inter- 
shown) also pass through interfaces 265 and 270 to nipt logic 330. Interrupt logic 330 contains weD-known 
control the operation of the processing element. 35 circuitry which generates a "polling" sequence that is 

The byte parity of infonnatian passing from data bus used to detennioe if any of the associated menaory ele- 
280, via cache data bus 285, to cache memory 250 is ments or bus adapters are generating an interrupt signal 
checked by parity checker 260 which consists of well- to request service. In particular, each memory dement 
known parity checking circuitry that provides error or bus adapter is "polled" or exammed in a predetcr- 
detection for information transferred from the com* 60 mined sequence to detect an interrupt The slave inter- 
puter system main memory to cache memory 250. faces are, in (urn "polled" by interrupt dicuitry (to be 

Dau transfers which occur between the processing described in detail below) in the master interface. Any 
dement and the processor bus via interfaces 265 and 270 interrupt detected by the slave interfaces is relayed to 
are controlled by the external control sequencer 245. As the master interface unit over the system bus via bos 
will be herexnafter discussed in more detail, sequencer 63 interface 310 m response to a polling signal received 
245 recdves syRchronization signals from internal con- from a master interface. 

trol sequencer 240 and controls data transfers by gating The operation of the entire slave interface is con- 
the appropriate addresses onto bus 280, generating con- trolled and synchronized by control logic 335 which 
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contains well-known clocking and sequence generating 
circuitry to provide synchronization signate lo the re- 
maining circuitry in the unit. 

A more detailed functional block diagram or a mem- 
ory dement is shown in FIG, 4. All memory elements 5 
contain identical circuitry and only one will be dis- 
cussed in detail for clarity. Each memory element is 
connected to both redundant memory buses by means 
of interfaces 4tO and 415. Each interface circuit con- 
tains circuitry which filters and bufTcTB 10 interrupt 10 
lines (6 information bits and 4 parity bits), 36 address- 
/data lines (32 information bits and 4 byte parity bits) 
and several associated control lines. 

Incoming address information is passed by interfaces 
410 and 415 to internal address bus 420 where the infor- 15 
mation is provided to address detector and generator 
circuit 455. Circuit 455 decodes and detects addresses to 
which the associated memory element is programmed 
to respond. In addition, in aocordanoe with well-known 
principles, it generates a sequence of address informa- 20 
tion which is needed lo access a block (128 bytes) of 
data stored in random access memory (RAM) array 
470. The information produced by circuit 455 is pro- 
vided to RAM timing and control ciTCuit 4ti0. This 
circuit also contains well-known circuitry which geoer- 23 
ates the timing signals (row and column address stiobcs) 
and the control signals (chip selects) which are used to 
control RAM array 470. In addition, RAM timing cir- 
cuit 460 contains circuitry to drive the address leads 
(the TOW and column addresses) needed to access infor- 30 
mation in RAM array 470 and lo provide periodic "re- 
fresh" signals in order to prevent information loss in 
array 470. 

RAM array 470 contains 320 64K dynamic random 
access memory devices. These devices are conven* 35 
tional, commercially-available memory devices avail- 
able from a number of semiconductor manufacturers. 
Array 470 is organized into an 8 row by 40 column 
array (2i' 32-bit word. 8 parity-bit rows). In response to 
timing control signals produced by circuit 460 and ad- 40 
dress signals provided via internal address bus 420, 
RAM array 470 provides stored information and associ- 
ated stored parity check bits to encoder/decoder 445. 
Circuil 445 accepts the 4(M>it encoded informatiOD re- 
treived from RAM array 470 and uses the 8-bit parity 45 
information code to identify and correct any single bit 
error in accordance with well-known error correction 
techniques. Also, in accordance with well-known error 
detection techniques the 8-bit error correcting code is 
used to detea all double and most multiple bit erron. 50 
Status flags arc set by circuit 445 to indicate that an 
error has occurred. Encoder/decoder circuit 445 a also 
used to generate byte parity bits which are sent along 
with all retrieved informatioD that is either correct or 
has been corrected by the error correction circuitry. 35 
The 32-bit information word retrieved from RAM 
array 470 (and possibly corrected) is providedt along 
with 4 parity bits, to the 36-btt internal data bus 420 and, 
via interfaces 410 and 415, to the memory bus and to the 
other units in the computer system. 60 

Several additional circuits are used to service the 
memory circuitry including interrupt logic 430, status 
and command logic 435. power monitor circuit 440 and 
control sequencer 450. Control sequencer 450 generates 
control and synchronzation signals which are used to 63 
sequence the memory element through its various oper- 
ations. These sequence signals are generated in a stan- 
dard fashion. 



Power monitor circuit 440 monitors the system 
power supply and generates a "dear" or reset signal 
when power b first ^iplied to the memory element In 
addition, power monitor circuit 440 also detects a con- 
dition in which only stand-by power is available so that 
the memory element can go into a refresh-only mode 
thereby reducing power consumption yet m a in t ain i n g 
the stored information intact. 

Status and command logic 435 stores status informa- 
tion (for example, fault conditions and the address being 
accessed at the time of a fault, etc.) for external access 
by the processing dements during a fault condition. 
Circuit 435 also accepts commands from the processing 
dements, which commands are used to set up diagnostic 
tests and other diagnostic functions. 

Interrupt logic 430 initiates interrupts to the slave 
interface in the event of a fault in the memory element 
and on initial power up of the memory dement to indi- 
cate that the memory unit is available and operational 
when it is reset or upon power-up. 

Although each processing dement contains identical 
circuitry, each processing dement is assigned a unique 
six-bit identification number which is detennioed by the 
electrical wiring of the connector slot into which the 
processing dement moduk b inserted. The identifica- 
tion number b used to identify each processing element 
to its associated master interface for control transfer and 
bus access operations as will be hereinafter described. 

The cache memory and the circuitry which controls 
it and performs the various moving and storing routines 
will now be described in detail. In particular, FIGS. 5 
and 6 show the allocation of the cache memory space 
among the supervisor and user programs which utilize 
the memory. In the illustrative embodiment, cache 
memory (memory 250 in FIG. 2) consists of a high- 
speed random access memory which has 128 kilobytes 
of memory. The entire memory can be uniqudy ac- 
cessed by a 14 -bit add ress code corresponding to ad- 
dresses 00000- IFFFF (in hexidecimal notation). The 
total 128K bytes of memory are divided between super- 
visor programs and the user programs which opermte 
with the cache memory. The division of the memory 
space between supervisor and user programs b prede- 
termined and fixed. 

More particularly, one half of the memory corre- 
sponding to the first 64K bytes of me mory sp ace (corre- 
sponding to address codes 00000-OFFFF) b perma- 
nently ""g"*^ for use by user programs <mly. Simi- 
larly, the remaining 64K bytes of mem ory (correspond- 
ing to address codes 10000-lFFFF) are permanently 
iny gTM*H for use by the supervisor program running in 
the associstfd microprocessor. 

Of the 64K bytes asogned to user programs, the first 
32K bytes (corresponding to address codes OOOOO- 
07FFF) are assigned permanently for storage of user 
program data. The next 32K bytes o f memory (corre- 
sponding to addresses 08000-OFFFF) are permanently 
itmg nfr f for use in storing user program cod e . 

A similar division (32K bytes each)b made for super- 
visor data and code. However, both the supervisor code 
and data areas are further divided into two 16-Kbyte 
areas. In one 16-Kbyte area selected super viso r pro- 
gram code which b frequently utilized b permanently 
stored. In the other 16-Kbyte area of supervisor pro- 
gram code b stored changeable or "overlayable" code, 
the contents of which can be changed during program 
operation to provide flexibility. 
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Tbe supervisor dau storage area also coosistmg of t6K byte cache memory section and the rcmaming 10 
32-Kbytcs of memofy is likewise divided i nto tw o 16- bits (bits 14-23) are desigtiated as the "labd" and stored 
Kbytes sectio ns (addresses 18000-lBFFF and in the block status memory. Since the translation be- 
ICOOO-IFFFF. respectively). As with the supevisor tween virtual addresses and fixed supervisor code is 
code, the supervisor data area is divided into fixed and 3 one-to^me, the 10 bit label is fixed (bit lA^ I and bits 
overbyable sections. 15-23—0). 

In the illustrative embodiment, the microprocessor The remainder of tbe virtual address space consisting 
unit is capable of generating 24-bit addresses (A0-A23) of approximately 16 megabytes (the entire vinual ad- 
and is therefore capable of individually addressing ap- dress space minus the 32K bytes already allocated to 
proximately 16 m^by tes of info rmation correspond- 10 ROM and fixed supervisor code) coirespondmg to ad- 
ing to addresses OOOOOO-FFFFFF On hexadecimal nota- dresses OOSOOO-FFFFFFF maps into tbe remaining 16K 
tion). In addition to producing address codes, such a byte supervisor code section of cache memory consist- 
microprocessor can also provide three function code ing of addresses ICOOO-lFFFF. As with the fixed super- 
signals (FO0-FC2) which specify whether the address visor code, the lower 14 bits of tbe virtual address space 
code signals produced by the microprooessor are di- 15 specify a location in cache memory. The temaining 10 
rected user data, user code, supervisor data or supervi- bits (Uts 14-23) are stored as a label in the associated 
sor code. The function code states corresponding to location in the block status memory, 
user data, user code and supervisor code spaces are FIG. 5B shows tbe mapping of the virtual addresses 
FC2-FCO=001, 010, and 1 10, respectively. For supervi- for supervisor data into the cache memory. The lower 
sor data. FC2-FO0= 101 and, in addition, address bit 20 16K bytes (consisting of addresses 00000(V0003FFF) 
A23 is used to distinguish between two types of ad- are mapped on a one-to-one basts into a fixed supervisor 
dresses memory addresses and special addresses. Spe- data area of 16K bytes (c<»sisting of addresses 10000- 
dal addresses are used, as will be hereinafter described. 13FFF). The next supervisor data apace is an oveilaya- 
during special cache memory control operations. ble space consisting of approximately B megabytes (8 

Since, the 24-bit address codes produced by the mi- 25 megabytes minus 16R bytes) starting at address 004000 
croprocessor can be used to address a total of 16M bytes and conttnuing to address 7FFFFF. This spttce maps 
of data, and since the cache memory has only a total of mto a 16K byte overlayable supervisor data space bi 
128K bytes of memory, some means must be used to cache memory consisting of addresses 14O0O-17FFF. 
translate or "map" from the address produced by the The remaining 10 bits are stored, as with the supervisor 
microprocessor into cache memory space. In particular, 30 code, tn the block status memory and used for matching 
in the illustrative embodiment a block sums memory is purposes upon access. 

associated with tbe cache memory. The block status The remaming 8 megabytes of supervisor data virtual 
memory contains a memory location for each 128 byte address space connsting of addresses 800000-FFFFFF 
block of information in the cache memory. When a are used for spcaal addresses during cache memory 
cache memory block is loaded from main memory, a 35 control operations as wiD be bereiiiBfter described in 
portion of the 24-bit virtual address is applied to tbe detail. 

cache memory to select a location in which to write FIO. 6 shows the allocation of the virtual address 
data. The remainder of the address (the "label") is space for user code aiKl user data. As shown in FIG. 
stored in the corresponding location in tbe block status 6A. the entire virtual address space consisting of 16 
memory. Later during an MFU access, this portion of 40 megabytes (addresses 000000-FFFFFF) translates into 
the microprocessor-generated virtual address is com- a 32 Kbyte user code area located at addresses <}8000- 
pared to the stored label associated with the accessed OFFFF in tbe cache memory. Hfteen bite (0-14) are 
block. A maich indica t es that tbe stored data is valid for required to uniquely address the 32 Kbyte r ^bf mem- 
the program running in the micrcqxiroessar. ory space and the remaining bits (15-23) are stored as a 

HG. 5A shows the correspondence of the virtual 45 9-bit label in tbe block status memory and used in a 
memory space to the cache memory space for supervi- similar fashion to the supervisor code and data labds to 
sor program code. Tbe total cache mentory address ch ec k for valid data. 

space atu) its allocation among supervisor and user pro- As shown in FIO. tfB, the entire 16 megabyte space 
grams is shown schematicaUy in the block at tbe right- for user data is also mapped into a 32 Kbyte 
hand side of the Figure. In tbe block at the left side is 30 memory sp ace sta rting at address COOOO and continuing 
shown the configuration of the total virtual address to address Q7FFF. As with tbe user code, a 9-bit label is 
space for supervisor program code. stored in the block status memory. 

In particular, out of the ^jproximately 16 megabytes Tlteopentian of the cache memory and its associated 
of virtual memory space capable of being addressed by support circuitry will be described in detail m connec- 
24 address bits, the first I 6K bytes (oorreqxmding to 35 tion with FIGS. 7 and 8. In particular, FIO. 7 shows a 
addresses 000000^3FFF) are assigned to locations in UockscfaematicdiagrBmof the support diroitiyassoci- 
the read-only memory unit associated with the micro- ated with the opcntton of the block status memory and 
processor (the read-only memory is designated as 205 in the cache memory. FIO. 8 shows a detailed block dia- 
FIO. 2). As previously described, information stored in gram of the circuitry used to read information from the 
the read-only memory 205 is used for system start-up 60 system main memory in the case that the requoted 
and diflg no stic programs. informatioo is not present in the cache memory. The 

The next t6K bytes of virtual address qksce are a»- rf#*«ilpd ttnn«>rmif« nf m^w y <Yf th#» rimnt >^i r^ ft not 
signed to nqiervisor program which b permanently shown u detail for clarity; however, the multiplexer 
stored m the ca che mem ory and (corresponding to and latch circuitry is standard in design and constmc- 
addresses OO4O0(MXnFFF) and translate on a one-to- 65 tion and its operatioD is well-known to those skilled in 
one basis to a 16K byte section of cache memory space the art. 

corresponding to addresses ISOOO-IBFFF. Only 14 bits Referring to FIG. 7, the cache control circuitry in- 
(bits 0>13) are needed to spediy each location in the eludes an internal wqucpcfr controller 700 which pro- 
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duces control signah that coordinate and synchronize to transfer mfonnatian among dicuit blocks as will be 

the operation of the various portions of the cache mem- hereinafter described in detail. 

cry and its support circuitry. The detailed constniction Under control of sequencer TOO, each prooemng 
of intemal wqiT*^^ concroUer 700 is also not shown element can be in one of eight weU-defmed states. Dur- 

for clarity. It can be constructed usmg either standard 5 ing each of these states a specific operation or routine is 
discrete logic circuitry, customized array logic or read- carried out by the processmg element circuitry. Each 
only memories in accordance with the state tables given sequencer state is designated by a one letter nmcmomc 
below. In particular, since it is advantageous for the code and consisU of one or more substates each of 
sequence cootroUcr to rcspwid quickly to access com- which occurs generally during each clock pulse of the 

mands from MPU 702 when it b in an -^idle'* state the >0 »ystan dock. . ^ • *u mi - . /-^ 
circuitry which is used to process signals from MPU Tte first of the ei^t stoto is the idle i^te CulcntiM 
702 wWch are generated while the sequencer is in its ^Vj^ mnemomc code "D- Intmial slate sequencer 
idle state is prcf^^^high^ dtocte or custom- 700 ^«^»°^f4!i^ ^ 
ized array logic circiuTrbTramunder of the se- MPU 702. Whde m tte tjk stole se- 

quencer^teSJyimplS^tcd using read^ymemo. 7« m^it^s^^ 

MPU 702 mdicating the type of operation requested by ™„tw«. ii«wJ; »t^ uMrMtt Jrnh^ 

MPU 702. Specifically, MPU 702 pioducea a set of ^ f^S^Jif^f^^^ Zn^^lL!^ 

address signaboa its 24 address leads Att-AlS (more » the MPU. the mtemal co^l sequaocr 

Ip^iSfMFU 702 do«^ generate an address 7^*™^*."^"-,?^ 
specincuiy. iwru /uj oo» toi ^^J™? upon a variety of conditwms which will be cxplamed m 

signal AO, but instead MPU 702 generates two data hereiniiter 

strobe signals. UDS and LDS. which are used to con- ^ ^ , ^ sequencer states is the ac 

trol the reoeption of data in the v"^"" <«^>' 25 knowledge state (designated by the mnemomc "A"), 
a valid addriM 15 present on "f^ AO-AM MPU 702 whii^ i„ this state the intemal control sequencer signals 
asserts the address strobe lead AS. In the foUowmg j^p^ ^ requested access operation has been 

description a reference to a signal (for ezample. AS) completed and the data requested by MPU 702 is avail- 
indicates that the signal is being asserted; the presence ^j^*^ 

of an asterisk foUowing a signal name (for example. 3^ sequencer state is the special acknowledge 

AS*) indicates that the signal is negated or not asserted. (designated as the "S" state). While in this state the 

MPU 702 also produces three fmictira code signals sequencer enables the block status memory or other 
FC0-FC2 as described above and a read/write signal, special registeiB, depending on the state of the process- 
R. which signal desig n ates whether the present opera- element at the time the state is entered, 

don is a read operation or a write opmtion. 35 j],^ fourth state is the read state (mnemonic **R''). In 

In addition, seque n cer 700 interacts with an external ^ ^t^te the intemal control sfqiifncrr activates the 
control sequencer (not shown). The external sequencer external control sequencer to enable data to be read into 
controls the flow of informadon between the processing ^ache memory 738 from the system main memory via 
element and the remainder of the computer system over processor data bus. 

the processor busses. The design and construction of 40 7^ my, the overflow state (mnemonic 

such a sequencer are straightforward and will not be g^m^ internal control sequencer 700 produces the 

described in detail herein. During its operation, the proper commands to service a cache "overflow*'. A 
external sequencer steps the processor bus control cir- cache overflow occurs if an item which would normally 
cuitry through a flxed series of operations in which the ^e retrieved from main memory and stored into cache 
processor bus drivers are controlled to gate information 45 memory 738 at a particular location cannot be stored 
between the processor bus and the remainder of the into cache memory 738 because that location already 
computer system. Received information is then format- contains valid data which must first be moved to main 
ted, checked for errors and forwarded to the intemal memory. 

data bus in the processing clement The operation of the In particular, in the event of a cache **miss" oocuning 
extemal sequencer (or bus transfer machine) is started 30 during an attempt to read information bom cache mem> 
by sequencer 700 when it asserts the start kad (ST). ory 738, circuitry in the pro ces sin g dement attempts to 
While the extemal sequencer a operating, it returns a transfer a block of data containing the addressed item 
busy signal (BB) to sequencer 700. After the requested from the system main memcvy into cache memory 738. 
data transfer operadon has been completed, the busy if the attempted transfer b suooesiful, data processing 
signal is negated (BB*). 35 proceeds oonnally.Ifthc attempted transfer results in a 

In the course of its operation, sequence controller 700 cache overflow, the block of information which b re- 
produces a number of signals wtudi are used to control trieved from main memory is stored in an **oiverfIow 
the various circuit blocks shown in FIO. 7 and also buffer" location in cache instead of its normal location, 
inform MPU 702 of the status of the requested opera- The addressed item is then fetched from the overflow 
tion. In particular, sequence controller 700 produces an 60 buffer and the instruction vftadh was being executed by 
acknowledge signal (ACK) which, u^ien asserted, indi- MPU 702 when the cache overflow occurred is allowed 
cates to MPU 702 that the requested operation has d- to complete. Normal data processing b then interrupted 
ther been initiated or completed as will be hereinafter so that special circuitry as described in detail below can 
described below. Other outputs (CE. R/W, WE) pro- store previoosly modified portions of the data in cache 
dnced by intemal sequence controller 700 are used to 6S memory 738 to main memory thereby making room for 
enable both cache memory 738 and block status mem- additional data m cache memory 738. Alternatively, if a 
ory 736, and control their read and write cycles. Still cache overflow occurs on a write access to cache mem- 
further ou^Hits are used to switch various multiplexers ory 738, the data to be written b temporarily stored in 
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the cache overflow buflier until its normal memory 
location b cleared. 

If, during a read or write access to cache memory 
738, a page fault occurs, the sequence of operations is 
slightly differenL The response to a page fault depends 
on wluther the fault occurs on an attempt to read pro- 
gram code firom cache memory 738. a d^ write opera- 
tion or a data read operation. If a page fault occtu^ on 
an attempted code retrieval, instead of returning the 



operation greatly reduces the amount of time that 
would otherwise be needed to effect a context switch. 

The last operational state of the processing element is 
called the move state (mnemonic **M"). In the move 
state, the internal sequencer generates signals which 
control additional circuitry to move data from one loca- 
tion in cache memory 738 to another location in cache 
memory 738. Such an operation is necessary because 
most computer programs mvolve frequent data trans- 



requested instruction, the cache memory circuitry re- 10 fc between user data and supervisor data areas in 



turns a special **tnip" instruction. MPU 702 is pro- 
grammed to recognize the trap instruction and there- 
upon initiate a request to become executive processor so 
that it can initiate a retrieval of the desired code from 
secondary storage. 

Page faults which occur on data write attempts arc 
treated similarly to cache overflows. That is, the data is 
temporarily stored in the cache overflow buffer and 
normal processing is interrupted. In response to the 



cache memory. For example, input/output operations 
are generally performed by a supervisor program on 
behalf of a user program. As a result, output data must 
be transferred from the user data area to the supervisor 
data area in cache memory. Similariy, input data from 
the supervisor area mu^ be transferred to the user area. 
Since these intracacfae data transfers occur relatively 
frequently during the operation of the user program, 
inefBdeocaes in the traiasfcr operation could signiJi- 



interrupt, the processing eleinent again requests to be- 20 ^antly effect overall system performance and overhead. 



come executive processor so that it can initiate the nec- 
essary retrieval of information from secondary storage 
and select a new user task. 

Page faults which occur on data read attempts force 
the processing element to stop normal processing and 25 
request the current executive processor to bring the 
desired page of data into main memory from secondary 
storage. After the transfer of data from secondary stor- 
age to main memory has been accomplished, the execu- 



In addition, any inefficiencies are compounded by the 
fact that the data transfer operations are frequently 
byte-oriented and hence need not be aligned on 32-bit or 
even 16-bit boundaries. 

With the aforementioned constraints, direct manipu- 
lation of the data by MPU 7D2 for each intmcache data 
transfer could require repeated byte operations and 
alignment thereby slowing the operation of the MPU. 
In accordance with an additional aspect of the inven- 



tive processor informs the processing dement experi- 30 processing element has bera provided with 

encmg the page fault of the locations m mam memory 



encmg the page fault of the locations in main memory 
containing the requested page. The processing element 
experiencing the page fault then resumes normal pro- 
cessing treating the page fault in much the same way as 



additional specialized hardware that automatically 
moves data in either direction between user and super- 
visor data areas in cache properly aligning the data in 
the process. A potentially large number of iterations 



a cache overflow. In particular, the addressed data 35 n^^LnTroTrim 
block is transferred to the cache memory and the cur. ^,7^ VW^S'^L^'E^ ^ £ 

thereby reduced to a single MPU instruction which 
commands the specialized move hardware to transfer 



Each of the eight operational states of the prooessmg 
element will now be described in detail in connection 
with FIGS. 7 and 8 and Tables I-VI which set forth the 
states and substates of operation. 
In taMes I-VI, the following abbreviations are used: 

UST OF TABLE ABBREVIATIONS 



Alibi Bvu D oo Duciiptwo 



rently executing instruction is allowed to complete. 
Normal processing is then interrupted so that the map in 

the memory management unit can be updated to indi- . . , . ^ . . 

r-ntr fTir ioi-.rir.r. nft\^rw,nrtr in n^nin .wn n wJTn ■ f f ■ r n ->n ■ An data bctwccn two qjccificd arcss M cachc mcmoTy 738. 

cate the location of the pagem mam memory. If a cache 40 j,^^ ^^^^ ^„w!ZL^^ i L-i-„ 

overflow also occurs m conjunctKm with the page fault 
the previously described processing which takes place 
after overflow also takes place after the page fault be- 
fore normal operadon resumes. 

The next state of the processing element is the exter- 45 
oal state (designated by mnemonic **E**) in which the 
processmg element performs transfers oUter than those 
to, or firom, main memory. 

The next state is caUed the flush state (designated by 
mnemonic "F') in which the internal srqnfncrr can 50 
control operation of the cache memory circuitry to 
store to main memory the contents of all of the dirty 
data blocks in cache memory 738. As previously men- 
tioned, in accordance with one aspect of the invention, 
the flushing operation is carried out by special purpose 55 
hardware connected with the cache memory which 
performs the flushing operation independent of direct 
control by MPU 702. In particular, MPU 703 can com- 
mand a between-limits flush. In which case, the qwctal- 
ized hardware automatically flushes all dirty blocks 60 
found within the specified limit range to main memory. 
In addition, the special purpose hardware allows the 
MPU 702 to require that the status bits stored m the 
block status memory and associfitcd with each block of 
data be reset when the block b flushed thereby hutial- 65 
izing the block status memory for subsequent cache 
memory operadons. The same circnitry can further be 
used to invalidate user or supervisor code blocks which 



M 



SA 



IR 



VcUd Bit Pfom Block 
Stttn Memory 
Dirty Bit Frao Block 
Scata Uenicry 
M *t cl i tntbnostkNi 



^lediJ Add. tisBi] 



Rcgttter Spec Add. 



ROM Rnd-ooty MoDory 



lAK 



EA 



Ext Specnl Add. 



Aaened • Data 
block k Valid 
Aaened * Dtu 
Block ia 'OMny" 
Aaamed - Ubel 
m BS Memory Matches 
MPU Addrm 
AMSted - MPU 
addreaa b Spedal 
AddnB 

AaKRed - MPU 
Addreu a an 
^^If^njil Rfi^pxtcr 
Addicn 

Aaoted » MPU 
Addira iito 
Read-oitty Ma aory 
AMTted - MPU 
AddrcM B an 
ntemipt 
•ckjMMiedfe 
AMertcd - MPU 
Addren b an 
Extenal Special 



06/13/2004, EAST Version: 1.4.1 



19 

-continued 



4,654,819 



UST OF TABLE ABBREVIATIOWS 
AbbrrviBticn Dttcripcioo Ueasmg 



IM 

IF 

BB 
PF 
T 

CL 



SO 
DO 
Of 



Move ^xicu] Add. 

Flusli Sped&l Add. 

Externa) Bus Busy 
Psge Finit 
Termiiutton Address 

OesTModc 



Source Addren Bil 
Desamtiaa Add. Bit 
Cootunt Mode 



Addim 

Aacncd B MPU 
Addnn b Move 
Oea. Addras 
Anoied » MPU 
Addna b Ftosb 
Desttotfian Add. 
AtKTted " External 
Bos b Busy 
Acacrted Page 
Fault Detected 
Anened - Flush 
Tcmtmation address 
Hatch 

AaKned FlBSh 
Opentioa ba 
dear OpetBtkn 
BitOorSauiGe Add. 
Bit 0 of Dot. Add. 
Anened - Move 
Operatiooba 
Cooaaat Operation 



TABLE I 
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TABLE l^condnued 



STATE 
NAME 



ACTION 



GONOmON 



S2C 



S2D. 



ROMs, etc 
Lower ACK and 
Eaabtet 
Jump to state I 



Uoeonditioml on 
Etil 



10 



Idle State 



15 



STATE 






NAME 


ACTION 


<jUND1I 1(?N 


tDLEO) 






lA. 


Jump to sute I 


AS* 


IB. 


Jump to state Al 


AS and SA« and (V 






mD) and M 


IC 


Jump to state Rl 


AS aoo >A^ aoo u 






and (V* or M*) 


ID. 


Jump to state 0) 


AS and SA* and D 






and M* 


IE 


Jump to state SI 


AS and OR or ROM 






SI.1AK) 


IF. 


Jump to state E) 


AS and EA 


lO. 


Jump to state M) 


AS and IM 


IH. 


Jump to state Fl 


AS and IF 


ACKNOWLEDGE (A) 




(Al) 






AU. 


Raise ACK to MPU 








Entry 


Aifi. 


Rabe CE to cache 








Eatry ( aixTcd 






with datt nrobes) 


AIC. 


Raise WE to BS Mbd 








Entry 


AID. 


Lower WE to BS Mem 








Exit 


AlE. 


Jump to state Al 










A2A. 


Retain ACK to MPU 




A2B. 


Retain CE to Cache 


UnooaditiOQal 






(AND'ed with daU 








A2C 


Lower ACK and 


t >- ililiMial *uk 




Enables 


Exit 


A2D. 


Jump to State I 




SPECIAL ACKNOWLEDGE (SI 




(Sl> 






su. 


Rabe ACK to MPU 


Uocooditiotial 


SIB. 


Raise Eoables lo 






Special Addren 


oo Address Decode 




Re«bten, RAMS. . 






ROMs, etc 




SIC 


Jump 10 itate S2 


Unoooditxxial 








SlA. 


Retain ACK to MPU 


UnLOuditasnal 


S2B. 


Retain EaaUes to 
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Special Addrm 
Regitten. RAMs, 



on Addren D e c o d e 



Table I shows the various operatkms perfonned in 
the Idle and Acknowledge states by intenial sequence 
controller 700 (FIG. 7) based upon various signals re- 
ceived by the controller. In particular, a processing 
element is in its idle state while waiting for MPU 7Q2 lo 
initiate an access. At this time no special external func- 
tions (flush* move, etc.) are being performed. During 
the idle state all internal paths are set up in such a man- 
ner as to pennit MPU 702 to initiate read and write 
cycles efficiently. In particular, addresses gc n c m trd by 
MPU 702 pass through address decoder 714 and are 
applied, via cache address multiplexer 726, cache* ad- 
dress latch 734 and cache address bus 735 to cache 
RAM 738 and block status memory 736. Block status 
memory 736 is enabled at all times so that its contenu 
(valid bits, dirty bits and labels) can be checked in time 
to allow sequencer 700 to acknowledge the requested 
access without requiring the MPU 702 to wait if cache 
menxiry 738 contains the requested data. 

The address information produced by MPU 702 may 
be one of several types. For example, the address infor- 
mation may be address information used to access cache 
memory 738. The foimat of the information placed on 
35 the local address bus by MPU 702 during an ordinary 
cache memory access is shown in FIG. 9, tine Al. Bits 
A01-A23 are the normal address bits. Bit AOO is not 
generated by MPU 702 but instead two data stitrfie 
signals are provided. The information on the local ad- 
dress bus may also be translated in order to access sys- 
tem main memory as will hereinafter be described. The 
translated information format is shown in FIG. 9, line 
A3 (to be discussed later). 
The address information produced by MPU 702 may 
45 also be a **special** address. Special addresses are used 
by MPU 702 to control other portions of the circuitry. 
In particular, a spedal address is generated by MPU 702 
by setting functioo code leads FC3-FO0 equal to **10r. 
respectively, and bit A23 of the address equal to 
so Special addresses may be either "external" or ^Hnteraal"* 
addresses. External qwcaal addresses are used by MPU 
702 to control elements external to the processing de- 
ment For exanqile, external special addresses are used 
during direct memory access operations, ^MA opera- 
55 tions) to control the operation of peripheral units and 
for other operations where the processing element co- 
ordinates and ctmtrols other ekanents in the computer 
system. FIG. 9, lines B1-B3 showed the arrangement of 
the data on the local address bus, the local data bus and 
60 the external address bus for an extenuU address situa- 
tion. In xcBpcxA to the local address bus, bit AO, as previ- 
ously described, is not generated by MPU 702 but in- 
stead two data strobe si^u^s are used. Bit Al is a direc- 
tion bit which indicates the direction of the daU transfer 
65 with respect to address module (Is read). Bit A2 is a bit 
that is set by MPU 702 to indicate to the bus adapters 
that the address is part of a DMA transfer. On a DMA 
transfer the processing element sends the destination 



40 
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address first and the source address last In additioii, if 
the tnin^er is s write operation the bus adapter ac- 
knowledges without receiving any data strobes. It then 
expects the data strobes m the next access, Bits A3-A7 
are reserved for a variant Add which selects one of the 
up to 312 addresses or functions within an addressed 
module. 

Address bits 12-16 contain a coded module LD. num- 
ber. Similarly, bits 17-21 contain a "basket" number 



22 



As previously explained, in the idle state, multiplexer 
726 is controlled by sequence controUer 700 to transfer 
the address information to cache address latch 734. 
Cache address latch 734 is controlled from sequence 
controller 700 to temporarily store the address informa- 
tion produced by multiplexer 726 and provide it to 
cache address bus 737. 

Six low-order bits of the address information (bits 
1-6) are provided to the cache address bus 737 from 



which together with the module I.D. number specifies a 10 local address bos 730 over bos 733 and multiplexer 740 



unique module in the system. Bits 22 and 23, as previ- 
ously described, specify that the address is an internal or 
external special address. 

The format of the local data bus for an external spe- 
cial address is shown b FIG. 9, line B2, in which bits 
SAfr-SA6 specify the location in the I/O buffer Cm 
cache) which contains the first word of the transfer. For 
DMA transfers this location contams the first memory 
address (the first of two memory addresses if 



which is also controlled by sequencer 700. 

Bits 7-16 produced at the output of cache address 
multiplexer 726 are also provided via bus 735 to the 
' address inputs of block status memory 736. As previ- 
15 ously described, block status memory 736 b continu- 
ously enabled so that its contents are immediately avail- 
able, thereby avoiding a delay which would force KfPU 
702 to wait for a label match check if the requested data 
is available in cache memory 738. In particular, the 



pMM="r', as described bdow). This memory address 20 outputs ofUock status mensory 736 consisting of the ten 

«-tf«i«%M«*£MuJ *A A — — - - - - - - - ^< a^i^ f _ ji* _ « ^ 



is transmitted to a destination memory for bus adapter- 
to-memory transfers followed by the extemal special 
address (^own in FIG. 9, line B3). For memory-to-bns 
adapter transfers, the special address is sent first, fol- 
lowed by the source memory address. 

The DMM bit is set by the MRU to select between a 
single memory and multiple memory DMA transfers. 
For a single memory transfer an address b taken from 
the designated location in the I/O bulTer and sent to the 



or nine bit label (depending on whether the requested 
access is to nipervisor or user ^laoe) and the valid and 
dirty bits are produced at output bus 747 and leads 741 
and 739, r e sp e cti vely. The output label information on 
23 bus 747 is provided via bus 745 and output latch 754 to 
the memory mapping circmtry shown m FIG. 8^ as will 
be hereinafter described. 

In addition, the label infonnatiao appearing on bus 
747 is provided, via bus 743, to comparison gates 724. 



bus. For multiple memory transfers, two memory ad- 30 Gates 724 compare label information cm bus 743 to 



address bits 15-23 of local address bus 730 which are 
provided to gates 724 over bus 725. The outputs of gates 
724 indicate whether the label information stored in 
block status memory 736 mntrhfs the high-order bits of 
the virtual address produced on local address 730 by 
MFU 702. The match information is provided to inter- 
nal sequence controUer 700 and partially determines the 
further actions of the circuitry. 
In re sp o nse to the match infonnation (M) and the 



dresses are taken from successive locations in the I/O 
buffer (DMM equal to 'tT defines to a angle memory 
transfer). The next 8 bits, TC0-TC7, are a transfer 
count which specifies one fewer than the number of 
words (for non-DMA transfers) or blocks (for DMA 33 
transfers) to be transferred. 

Internal special addresses are used by MFU 702 to 
control the special processing element circuitry, such as 

during a cache move or cache flush operation. External ^ _^ 

special addresses are used by the MFU to control exter- 40 dirty and valid bits (D and V), ffgwmrf controller 700 
nal elements. The distinction is specified by address bit detomines whether the requested access has resulted in 
A22 which is "1" for internal addresses and *V for a cache **hit*' or a cache **tnt«t** As shown in Ime IB of 
external addresses. Table I. a cache hit occurs ifa label match has oocuncd, 

Referring to T^le I, line lA, the processing element the dirty and valid bits indicate that the data b either 
remains in the Idle state as long as the address strobe 43 dirty or valid and the specified address a not a special 
line (AS) produced by MFU 702 remains unasserted. address (deteimmed by controUer 700 by >«mmmg 
When MFU 702 does assert a signal on address strobe address bit A23 • A23i=**l" b a special address), 
line AS, sequence controller 700 enters one of the other Line ICofTable I indicates the conditions for a cache 
processing states described above depending i^xm the *'miss". A cache miw occurs when the address strobe 
status of signab received from block status memory 736 SO signal (AS) b asserted, the requested address b not a 



and MFU 702. In particular, to begin an access to cache 
memory 738, MFU 702 places an address on its address 
leads A0-A23 and asserts the address strobe signal on 
lead AS. The address outputs are provided, via drivers 
704, to local address bus 730. The format of the address 33 
signak on bus 730 b shown in FIG. 9 line Al in which 
A01-A23 correspond to address bits A1-A23. Bit AO b 
not generated by MFU 702 which instead generates two 

data strobe signals. From bus 730 bits 7-13 of the ad- 

dress infonnation are provided, via bos 731, to cache 60 the requested data b available in r trh r memory 738. 
address multiplexer 726. Controller 700 then asserts the cache enable lead (CE) 

Bits 5,6 and 14-23 of the address information pro- to cache memory 738 which end>ki the memory so that 
duced by MFU 703 are also provided to cache address in the case of a read operation, data stored in it can be 
translation logic 714. Translation logic 714 translates gated, via drivers 748, to local dau bus 732. Altema- 
virtual address information into the appropriate fixed or 63 tively. in the caae of a write openlion, placed on 
overlayable region of cache memory (shown in FIO& 5 local data bus 732 by MFU 702 b applied to "Muffle 
and 6). It produces three output bits which are applied bus** 856 (shown in FIG. 8) by means of drivers 852 
to multiplexer 726 along with the 7 bits from bus 731. which are controlled by w^^ht*^ 700. From bus 852, 



special address (SA*), and the signab from block status 
memory 736 uuticate that the requested data b niM dirty 
and either b not valid or there b oo label match. 

Acknowledge State 

Asstunittg a cache hit oocnzs, sequencer 700 proceeds 
to acknowledge sute A. consisting of subsutes Al and 
A2. When in acknowledge state Al. sequence control- 
ler 700 asserts the ACK lead to MFU 702 indicating that 
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nal gfqucnccT a started in order to transfer tnfonnation 
from system main memory into cache memory. 



the data posses via enabled drivers 854 to bus 862 and 
the data input of cache memory 738. 

Subsequently, fTable 1, line AlC) controller 700 as- 
serts the write enable (WE) lead to bkxJt status memory 
736 to allow new label, dirty and valid information to be 3 
written to memory 736 thereby updating it to corre- 
spond to the new status of cache memory 738. In the 
case of a read operatkm. the block status label (bits 
15-23 of the virtual address) is unchanged and thus the 
same label is rewritten into block status memory 736. In 
the case of a write operation, the same block status label 
is written into block status memory and the dirty bit is 
set in the proper location to update the memory. More 
particularly, the "label" information (bits 15-23 of the 
virtual address information) are provided via multi- 
plexer 750 to the data input of block status memory 736 
to enable the information to be written into the ai^ro- 
priate location. 

Block status memory 736 may also be written directly 
by MPU 702 in order to allow the MPU operating sys- 
tem to set up the block status memory. Spedfically, to 
load block status memory 736, MPU places an address 
on local address bus 730 in the format shown in FIG. 9, 
line Fl. As shown in FIG. 9, bits 007-^16 are cache 
address bits specifying the particular block status mem- 
ory location to be written; these bits are placed on the 
cache address bus 737 from the local address bus 730, 
via bus 731 and cache address multiplexer 726. The 
information to be written into the specified location is ^ 
placed by MPU 702 onto the local data bus 732 in the 
format shown in FIG. 9, line F2, where *W" is the valid 
bit. "D" is the dirty bit, Z-Z are zeroes and L14-L23 are 

the label information. From the local daui bus, the data In particular, the external sequencer forwards a phys- 
is applied to the data input of the block status memory 35 ical address to the system main memory which re- 
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TABLE II 






OONDinON 


READ (R) 






fRI) 






SIA 




Uaconditkmtt m 






Entry 


RIB. 


Jump to ttftie Rl 


BB ind.ffF* £T R 






and CD*) 


R1C. 


Jmnp to VMte Ol 


PF and R* 


RID. 


Jump to state R2 


BB and PF and R 






and CP 


RIE. 


Jinttn tn t«f A] 


BB* 


fR2* 






R2A. 


Stem Extenul 


Umodditioiial 00 






Entry 


R2B. 


FimKI* Tran Ituinic- 






tioa to LDB 




R2C 


RiiK ACK to MPU 


UaooDdhioiMl 00 






Entry 


R2D. 


Jnmp to itBte K3 




m) 






R3A. 


Keep Tnck lastractioa 






EiubleioLOB 




R3B. 


Retaio ACK to MPU 




R3C. 


Lower ACK to MPU 








Eih 


R3D. 


liimji lo itiie 1 


BB* 


R3E. 


Jump to lUle R4 


BB 








R4A. 


Do DOtbing 




R4B. 


Jump to state R4 


BB 


R4C 


Jutnp to trstc I 


BB* 



via multiplexer 750. 

After the status information has been written into 
block sutus memory 736, sequencer 700 proceeds to 
acknowledge state A3 where the ACK lead and enable 
signals to memories 736 and 738 are lowered, complet- 
ing the processing of a cache hit and returning the pro- 
cessing element to the idle state. 

Assuming now that a cache miss occurs on an at- 
tempted read access to cache memory (TaUe I, tine IC) 



sponds, as previously described, by returning a block of 
data containing the requested infomutioD. The data 
block is, in turn, stored in the appropriate location of 
cache memory 738. The physical address used to ad- 
^ dress main memory is produced by the memory man- 
agement circuitry shown in FIG. 8 which is controlled 
by sequencer 700 to translate the virtual address pro- 
duced on address leads A1-A23 of MPU 7Q2. 
If the access request by MPU 702 to cache memory 



. the requested information stored in the computer's 43 738 was a user data read or write operation or a user 

!_ . ^ t - - ^- J aL.^ AA^^ C^^^X* *Wa ji^niai ' n rl rlTfffi 4vA*Mi1*#«An irr 



main memory must be transferred into the cache mem- 
ory before processing can be completed, therefore, 
sequencer TOO preceeds to the read state R. 

Special Acknowledge State 

The ^jecial acknowledge state is used to inform MFU 
702 that an operation requested by a q»ecial address (for 
example, a flush or move operation) has been com- 
pleted. The special acknowledge state has two substatcs 



code fetch, then the required address translation is per- 
formed by map RAM 814 shown in FIG. 8. In puticu- 
lar, bits 11-23 of local address bus 804 are gated, via bus 
808, to user map multiplexer 810 under oootrol of ae- 
30 quencer 700. Multiplexer 810 is, in turn, controlled by 
sequencer 700 to forward the address information over 
bus 812 to the address inputs of map RAM 814. In re- 
sponse to the address inputs, map RAM 814 provides a 
20-bit translated pbysiol address output (UMAP bits 
SI and S2. In substate SI (Table V, line SIA) the ACK 55 U-31 which become the high-order bits of the physical 
lead is asserted, infoming MFU 702 that the requested address) over bns818 to moduk address bus multiplexer 
operation has been completed. Various registers which 838. 

hold the results of the q>ecial operation are enabled to The translation information is written into map RAM 
provide the data to MPU 702 (line SIB). Sequencer 700 814 following a context switch by MFU 702 usmg an 
then jumps to substate S2 (Table I, line SIC) where the 60 internal special axldrcss command. Smce the map RAM 
ACK lead is «»«^"tniw#irf asserted to allow the required contains 20-btt address information and the local data 
dau to be transferred (lines S2A and SIB). Fmally, the bus is only 16bit8 wide the loadmg operation must take 
enables are removed and the sequencer returns to the place in two steps. The most significant word (MS 
idle state (lines S2C and S2D). word) a loaded first, then the least significant word (LS 

65 word). The formats of the information on the local 
address bus and the local data bus are shown m FIG. 9. 
lines C1^C4. Line CI shows the format on the local 
address bus for loading the MS wcrd into map RAM 



ReKl State 



Read state R has four substatcs R1-R4 which are set 
forth in Table IL In read sute Rl. line RIA, the exter- 
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814. Bits V12-V23 are the address into which the pbysi. MS word loading operation. Bits P24-P31 are the phys- 
cal address infonnation is to be loaded. Bit MS selects teal address bits to which the mappable supervisor data 
the portion of the map RAM to be accessed (MS«"1" page wiS map when accessed. BiU Z16-Z23 are the 
for user code and MS»*X)'* for user data). FIO. 9. line physical address bits 16-23 obtained from the map regis- 
C3 shows the information on the local data bus which is 5 ter on a read operation and are "don't caits" on a write 
to be inserted into the location spectftcd in line Cl. Bits to the register. Similarly, the information format on the 
P24-P31 are the physical address to which the specified local data bus for a load of the LS word is shown in 
location will map when accessed. Bits Z are zeroes on FIG. 9, line D4. 

reads and don't cares on writes. The supervisor data register may be read by MPU 

Similarly, FIG. 9. lines C3 and C4 show the informa- 10 702 by applying the infonnation fonnat shown in FIG. 
tion format on the local address bus and the local data 9, Unes Dl and D3 for the MS word and LS word, 
bus for loading the LS word. The infonnation is analo- respectively to the local address bus 804. This informa- 
gous to that in the MS word with the exception of bits tion controb multiplexer 826 (bit AOl in particular), via 
EN0-EN3 which are quadrant enable bits. Each page in lead 823, to gate portions of the register output over 
main memory is divided into four quadrants of equal IS buses 825 and 830 through multiplexer 826 onto local 
size. Each quadrant enable bit. when set to "1 " indicates data bus 806 via bus 831 In particular, the high-order 
that its corresponding quadrant is enabled indicnting, in bits (bits 8-15) of the MS and LS physical address 
turn, that the data for that quadrant is available in main words are provided directly to the local data bus via bus 
memory. If an access is attempted to a quadrant whose 834. The low-order bits (0-7) are controlled by multi- 
corresponding enable bit b set to **0" a page fault will 20 plexer 826 in the fonnat shown m FIG. 9. lines D2 and 
Ttsulv 04, for the MS arKl LS words respectively and pro- 

The loading operation is performed by sequencer 700 vided to local data bus 806 via bus 832. 
by controlling multiplexer 810 to connect bits 12-23 of If the read access is to Doo-mappabk supervisor dau 
local address bus 804. via bus 808 and bus 812, to the then multiplexer 838 is instead ccmtrolled to pi»^ bits 
address inputs of map RAM 814. In addition, sequencer 25 7-23 of the local address bus (obtained from bus 835) 
700 enables drivers 822 to connect local data bus 806 to onto bus 839. 

the data inputs of map RAM 814 via bus 820. Infonnation transfer between main memory and 

In accordance with another aspect of the bvention, cache memory 738 is always carried out on a block basis 
instead of loading map RAM 814 with translation data, (one block is 128 bytes of daU). Twenty-five bits of 
the illustrative circuitry can be used to automatically 30 address information arc needed to specify a particular 
clear vaap RAM 814 during a context switch without block in main meraory and, as previously described. 20 
requiring intervention by MPU 702. In particular, dur- of the required 25 bits are provided from user map 
ing an auto-clear operation sequencer 700 controls mul- RAM 814 or supervisor translation register 824. The 
tiplexer 810 to connect the output of dear counter 800 remaining five bits are set equal to bits A07-A11 of the 
on bus 801 to the address inputs of map RAM 814, via 35 virtual address which are gated to multiplexer 838 from 
bus 812. In addition, sequencer 700 enables drivers 816 local address bus 804 via bus 834. 
which drive "0"8 into tht quadrant en^le bits locations The physical address sent to the main memory con- 
of map RAM 814. To perform the clearing operation, sisu of a total of 32 bits of infonnatioa and the format of 
counter 600 is reset and steps through all locations of the address information b shown in FIG. 9A2. The 
map RAM 814. Therefore the quadrant enable bits of all 40 address u broken into 25 ]diysical address bits 
locations arc set to causing aU entries in the RAM (P07-P31) and 7 control bits (SPA, DIR, DMA, and 
814 to be invalidated. BC0-BC3). The control bits arc set by MPU 702 and are 

If a read access is performed to an area of supervisor used to inform the remamder of the system of the type 
data space which b mappable. the required tnuulation b of access requested. In panicular, bit SPA b set by 
provided by supervisor translation register 824. Regis- 45 MFU 702 and j^^i*-^**- whether the address b a special 
ter 824 b a 20-bit register which contains the required address. It b set to "0" by MPU 702 for a memory 
translation infonnation. Thb translation information b access openHon. Bit DIR in dHitf ft the transfer dirvc- 
selected by the MPU by controlling multqilexer 838 to ticm with respect to the PEri"* read opeisdon) The 
select the output of the supervbor map register 824 (bits DMA bit b set by MPU 702 and b used to determine 
SMAP 12-31) via bus 828. SO whether the address b part of a DMA transfer. The 

Module address bus multiplexer 838 b controUed by remaining control bits spcdfy the length of the transac- 
signals produced by sequencer 700 and signab on cache tion in blocks. 

address bus 737 (FIG. 7). In particular, selection signab The control bits are generated by a pcrmanently- 
are provided from sequencer 700 directly to multiplexer wired pattern gencTBtor over bus 841. The completed 
838. Bits 12-16 of the cache address bus are provided. 55 324iit address b forwarded at the output 899 of multi- 
via bus 846, to decoder 844 which, in turn, provides plexer 838 to the **shufne bus" circuitry consisting of 
additional selection signals over bus 842 to multiplexer drivers 850. 85^ 854. 858 and shnfOe bus 856. In panic- 
838. ular. to transfer the 32-bit address to the p ro cea a oi bus 

The supervisor data register may also be loaded with for transmission to the main memory, sequeocer 700 
new information at a context switch in a similar manner 60 enables driver 850 and 858. The address informatioa b 
to the user map RAM 814. In particular, the loading ther^ transferred from multiplexer output bos 839. via 
ioformation format b shown m FIG. 9. lines Dl and D3, driver 850, shuffle bus 856 and driver 858 to external 
for the local address bus. Since there b only one *1oca- address bus 864. Under control of seqoeDcer 700, Che 
lion" in the supervisor translation register, no address infonnation on bos 864 b latched in output latch 866 
information b provided. The address b the same for the 65 from which it b gated under control of the external 
MS and LS words with the exception of bit Al (*V for sequencer, over bus 870. to the processor buses and 
MS word and "1" for LS word). In FIG. 9, line D2. the from there, as previously described, to the main mem- 
information on the local address bus b shown for the ory. 
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waits nntil the externa] bus is do longer busy as indi- 
cated by the oegation of the BB signal by the external 
sequencer. In some cases, the external s e q uencer may 
take longer than a single clock cycle to terminate and if 
so, as indicated in Table 11* Une R3E the sequencer 
jumps to substate R4 which causes it to wait tmtil the 
external sequencer terminates at which point, as shovm 
in line R4C it returns to the idle state. 



Overflow State 

Overflow processing b shown in Table III. The oper- 
ation of sequencer 700 in servicing an overflow condi- 
tion depends on whether the attempted access whk:h 
caused the overflow condition was a read or write ac- 



TABLE in 



STATE NAME ACTION 
OVERFLOW (O) 
(Ol) 
OlA. 



CONDITION 



While the information transfer is taking place be- 
tween main memory and the cache memory, sequencer 
700 monitors the busy line (BB) from the external se- 
quencer to determine when the requested information 
tranfer has been completed (line RIB of Table II). Se- 
quencer 700 also monitors the output of page fault cir- 
cuit 873. the read/write lead (R) from MPU 702 and the 
function code leads (FO0-FC2) from MPU 701 

Page fault circuit 873 monitors the physical address 
information at the output of user map RAM 814 on bus 10 
818 by checking the quadrant enable bits of the re- 
quested page to determine whether the information is 
available in main memory. If the information is not 
available in main memory a "page fault** situation oc- 
curs and a signal is sent to sequencer 700 by page fault 15 ces& In addition, there are two ways to enter state Ol. 
detect circuit 873. The function code leads Crom MPU One way is if an overflow occurs when seq u c n rr f 700 
702 indicate whether the requested access is a code responds to an access request while it is in the idle state, 
access (an access to either supervisor or user code as shown in line ID of Table I. This condition is de- 
space) or a data access, tected if the accessed information b dirty bot there is no 

If the requested access is to data space and no page 20 match between the block status label stored m the block 
fault occurs, then internal sequencer 700 jumps to ac- status memory and the ''label*' portion of the requested 
knowledge sute Al, as shown on Table I, Une RIE. as address. The other way that overflow state Ol is en- 
soon as the external control sequencer i nd ic a te s the tered is if a page fault occurs on a write operation, as 
transfer of information from main memory to cache shown in Table n, line RIC. 
memory has been completed. In particular, to complete 25 
the transfer, the external control sequencer gates infor- 
mation obtained from the main memory via the proces- 
sor bus onto bus 860 and from there, via bus 8<S2, to the 
data input of cache memory 738. 

If a page fault occurs during a write operation, as 30 
indicated in line RlC of Table II, an overflow condition 
occurs and internal sequencer 700 enters overflow state 
01, as shown in Table IIL Processing of an overflow 
condition will hereinafter be discussed in detail. 

If, on the other hand, a page fault condition occurs on 35 
a read operation to either supervisor or user code space, 
as shown in line RID, the sequencer enters read sub- 
state R2, shown in Table II. As shown in Table II, page 
faults which occur on a code read are treated differently 
from normal page fault processing. In this case, MPU 40 
702 is forced into bringing the required data block from 
main memory into cache itself rather than making a 
request to the executive processor for page fault service 
in the case of normal page fault servicing. In particular, 
in line R2A the external sequencer is disabled and in- 45 
stead a special '*trap" instruction is gated onto the local 
data bus from hardwired instrudioii coder 872 
R2B) in place of the requested instruction. Internal 
sequencer 700 then asserts the AOC lead to MPU 702 
mrlif^riwg th^ ri>qiM!Kted ift ftiru ctiftu k rody on the local 50 
data bus. The MPU 702 recognizes the trap instruction 
as a special instruction and exe c u t es a predetermined 
program which causes it to request the proper block of 
code from main memory and transfer it into cache mem- 
ory 738. 55 

In particular, the trap instruction causes the affected 
pi occ ssiu g element to request to become the executive 
processor so that it can initiate a transfer in of the de- 
sired code. After the processing element becomes the 
executive processor it also performs other executive 60 
functions including selecting for itself a new user task as 
previously described. 

After placing the trap instruction on Uie local data 
bus and disabling the external s eq ue nc er , seque n Rc r 700 
jumps into read substate R3, in which it waits for a short 65 
time keeping the trap instruction on the local data bus 
and the ACK lead asserted, as shown in lines R3A and 
R3B and then lowers the ACK lead to MPU 702 and 



OIB. 



OIC 



OlD. 

OlE 
OIP. 
(021 
02A. 

02fi. 

02C 

OlD. 

OZE. 
f031 
03A. 

03B. 



03C 

03D. 
03E. 
i2!i_ 
04A. 

04B. 
04C 

0«D. 

04E. 

04F. 

040. 
(05) 
05A. 



Steptesicex 
DinUe Extcrokl 

Ettsble Aildrctt 
Overflow BufTer 
AddrmtoCAB 
EoabfeVAetc. 
to SDB 

Jump to lUle 02 
Jujcp lo ftate 03 

Retain VA etc 
to SDS 
RetAin AOVF 
Addr. toCAB 
Raise CE lo cache 

Rdx WEtoBS 
Mem 

imnp to tXMie 03 

Enable LDB to 
SDB 

Enable Dwa 

Overflow BofEer 

AlJdieti to CAB 

InaeLevd? 

Interrupt 

Jump to ftste 03 

Joitp to ttMtt 04 



Raiie ACK to 
MPU 

Retatn LOB to SDB 
Retun EX>VF 
Addr. to CAB 
RabeCE to cache 

Rabe WBtoBS 
Mem 

Lower WE to BS 
Mem 

Jump to itate OS 

Retata ACK to 
MPU 



UocoDditkntkl 

R» 

R 

Unconditional 

Unoo o d ttion al 

Uaoondhiooal on 
Entry 

Etttry 

^JoQOodx&Qn^J 
Utiooodittocial 
Uocooditiooal 



BB 
BB* 

Unooiid tlpflft^l OD 
Entry 

UnooodiiiaBa] 
Unoooditiaoa] 

Urtififiriilinml on 
Entry 

U iMJOiidilkiual oo 
Entry 

UdooikI 1 1 WH I al 00 
Exii 

Unronrifimnal 
Uocooditional 
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03B. 


Reuin LDB to SDB 




05C 


RetuaDOVF 






Addx. to CAB 




03D. 


Reum CE to cacbc 
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05E. 


Lower ACK and 






F,TnMrt 


Exh 


05F. 


Jump to itste I 


Uncofidttkmal 
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TABLE Ul-conthiued operation and. in line 05F, sequencer 700 returns 

to its idle state. 

Alternatively, if an overflow conditian occurs during 
a write operation, a difTerent processing routine is fol- 
3 lowed. This routine is more complicated than overflow 
processing during a read operation since the write ad- 
dress must also be saved during processing and later 
reconstructed to plaoe the overflow data in its proper 
location. In order to save all the data and address tnfor- 
10 mation necessary to recon^nict the overflowed opera- 
tion, address information overflow bufTers are used in 
If the operation which caused the overflow is a read addition to data overflow buffers, 
operation, as shown in line OlA of overflow substate As shown in line OIB, an overflow during a write 
Ol. the external sequencer is enabled to begin the trans- operation causes sequencer 700 to disable the external 
fcr of information from the main memory to cache I3 sequencer immediately since no information will be 
memory in the same manner as if an overflow condition transferred until later in the processing. Sequencer 700 
had not occurred. However, since the space in cache then controls cache address multiplexer 726 to gate a 
memory 738 into which the incoming information is to predetermined address onto cache address bus 737 via 
be placed is not available, the incoming information is cache address latch 734. The predetermined address 
instead placed in one of two special cache "data over- 20 specifies one of the two address overflow buffer areas 

flow buiFTers** which are predetermined portions of the (designated as address buffen 0 and 1 the selection 

supervisor data area of cache memory 738. As shown in between the two address overflow buffers is by 
line 02F. after starting the external sequencer, se- riaminhig the sute of virtual address bit 7). Specifi- 
quenccr 700 proceeds to substate 03. cally, sequencer 700 controls overfkrw multiplexer 722 

In overflow substate 03. line 03B, sequencer 700 23 to gate virtual address bit 7 from the local dau bus. via 
controls overflow multiplexer 722 and cache address bus 723, into cache address multiplexer 726 and from 
multiplexer 726 to gate the address of the data overflow there to the cache address bus. The remainder of the 
buffers onto cache address bus 737. The cache overflow special address is generated by a permanently wired 
buffer address consists of a predetermined bit pattern pattern generator connected to multiplexer 726 and 
and bits 0-^ of the virtual address provided via bus 731 30 virtual address tnts 0-6 received form multiplexer 726 
and multiplexer 726. In particular, the dau overflow over bus 731. Sequencer 700 then enables a path be- 
buffer address on cache address bus 737 specifies one of tween local address bus 804 to shufHe bus 856 (Uoe 
two data overflow buffers (designated as buffer 0 or OlD) by controlling multiplexer 838 to provide address 
buffer 1) as determined by virtual address t»t 7 which is informadon from the local address bus 804 (bits 8-14). 
provided by multiplexer 722. The buffer locations sped- 33 via bus 835, to bus 839 and from there, via enabled 
fied by virtual address bits 0-6 are written to with the driver 850, onto shuffle bus 856. From shuffle bus 856 
incoming data from the main memory. the address information can be driven onto bus 862 via 

Next, as shown in line 03C. a special intemipt (level driver 854 to enable selected portions of the address 
7 interrupt) is generated by sequencer 700 which causes information to be written into the cache address over- 
MPU 702 to stop normal processing and flush cache 40 flow buffer locations as will be hereinafter described, 
memory 738 to main memory to make room for the SfqiTrncrr 700 then jumps to substate 02 (line OlE). 
information in the overflow buffers after it finishes exe- As shown m lines 02A and 02B, the address of the 
cution of the current instruction. The operations of address overflow buffer is retained on the cache address 
MFU 702 upon receiving a level 7 mterrupt are dc- bus and the data path from the local address bus and the 
scribed in detail below. 43 shuffle bus is also retained. Next, as shown in tine 02C 

After genenling the level 7 interrupt, mtemal se- of substate 02. the enable lead to cache memory 738 is 
quencer 700 remains in substate 03, as shown in line asserted to enable the address infonnatioo to be written 
03D, until the external sequencer indicates that the into the memory. More particBlariy. the byte locatkms 
incoming data from the main memory has been trans- in the address overflow buffer spedfied by virtual ad- 
ferred into the cache memory as shown in line 03E at 30 dress bits are all written with the data pattern 
which time srq n m ocr 700 moves to substate 04. shown in FIO. 9, line HI. In this pattern the •^^^ of 

In substate 04. line 04A. the ACK lead is asserted to the most significant bit ofeach address byte equal to **!** 
MPU 702. In lines 04B and CMC, sequttioer 700 retains indicates that the **«^«Tfff byte in the data overflow 
the connection between the local data bus and the sbuf- buffer has been tiw«fiii.rf The remaining bits of each 
fie bus and retams the data overflow buffer address on 55 byte in the address overflow buffer contain virtual ad- 
the cache address bus. Subsequently, as shown in line dress bits 8-14 of the location origmally addressed hy 
04D, the cache enable lead is asserted providing the MPU 702. 

requested data from the overflow area in cache memory Similarly, as shown in line 02D. the write enable lead 
738 to MFU 702. In lines 04E and 04F. the block status (WE) is asserted to block sutns memory 736 (o enable 
location for the data overflow buffer is updated to indi- 60 status information and a new label (bits 15-23 of the 
catc that the location addressed by MPU 702 is valid virtual address) to be written into that memory, 
and to also store the oorresspooding label (virtual ad- Sequencer 700 then junqn to substate 03 (as shown in 
dress bits 15-23). Sequencer 700 then pr oceed s to over- line Q2E) where p roces sin g continDes as described in 
How substate 05. c on nect io u with read overflow processing with the 

In overflow substate OS, as shown in lines 65 exception that instead of the daU overflow buffers 
05A-05D, sequencer 700 maintains the certain address being written with information obtained trom the maiti 
and control signals. In line 05E the ACK signal and all memory, a connection u set up between the local data 
of the memory enables are lowered to complete the bos and the shuffle bus (over bus 869 and driver 852) as 
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set forth in lineOSA to allow data to be written into the 
addressed data overflow bufTcr from MPU 702. 

In response to a level 7 interrupt generated during 
overHow handling by sequencer 700, MPU 702 reads an 
interrupt status word in order to determine whether a 
block overflow has occurred, and. if so, which data 
space overflowed (either user dau or supervisor daU). 
MPU 702 then determines whether any write overflows 
have occurred by placing the virtual address of the data 



A second flush is then performed on the affected data 
space. Next, the blocks previously saved are moved 
back to their appropriate cache locations and a second 
flush is performed on theoL Finally, the overflow bafT* 
ers and block status locations for the overflow bafTers 
are cleared. 

External State 
Table IV shows the processing steps for processing a 



nave occuiroi oy pmuiig lmc vulwu buui«w ui — — • » r - - 

overflow buffer block status word on the local address 10 transfer of data between the processing element and 



15 



bus. The format of the information on the local address 
bus is shown in RG. 9 line Fl. Bits 1-4 are in a preset 
pattern (0110). Bits C7-C16 arc the part of the cache 
address used to address the block status memory, (the 
X's are don't caies for a block status nad). Fmally bits 
22 and 23 are set ("1") indicating that the address is an 
internal special address. This address informatioo is 
gated, via multiplexer 726 aiul bus 735, to block status 
memory 736. The output of block status memory 736 is 
provided, via bus 749. to driver 752 and from there to 
the local data bus over bus 761, local data bos 732 and 
drivers 716 to MPU 702. The output of memory 736 u 
formatted as shown in FIG. 9. line FZ Bit V is the valid 
bit; bit D is the dirty bit; bits Z are zeroes and bits 



external locations other than main memory. 

TABLE IV 



STATE NAME ACTION 



CONDmON 



EXTERNAL fE) 

fEn 

EIA. 

ElB. 

EIC. 
EID. 



Eaabk EttenttI 

Eiable l/OBoffcr 
Adctrcs 10 CAfi 
Jtnnp to ttate El 
Jump to tuu SI 



U n oo ndhiona l on 
Esuy 

UoconrfiiifFfttl 

BB 
BB* 



As shown in line EIA. the external sequencer is en- 
bit; bit D is the dirty bit; bits Z are zeroes and mts abled to begin transfer of the data information to the 
L14-L23 contain the label information. MPU 702 exam- remainder of the computer system. In line ElB the 



toes the dirty bit for each of the data buffers and if this 
bit is set ("1") then write overflow processing is neces- 
sary; otherwise read overflow processing is performed. 



appropriate I/O buffer address is placed on the cache 
address bus. In particular, overflow multiplexer 722 is 
controlled by sequencer 700 to place bits 5 and 6 of the 



ly- UUIUWUC JCOU WVfc»H«T» IfluvwawQ w ™. wuMvn "J f 

The MPU actions on read overflow processing re- local data bus on cache address bits 7 and 8 thereby 



quire only that the ^propriate data space (either user or 
supervisor) in cache be flushed as will hereinafter be 
described to make room for the new data temporarily 
stored in the overflow buffers. 

Write overflow processing is somewhat more compli* 
cated since the written data must be recovered from the 
overflow buffers and returned to the appropriate loca- 
tions in memory. In particular, for each data overflow 
buffer which is dirty, the corresponding address over- 



specifying the I/O buffer to be used n the transfer. The 
remainder of the I/O buffer address is loaded from local 
data bus biu 0-4 into external address counter 742. 
Sequencer 700 then thereupon oontrok multiplexer 740 
33 to place the external address on the cache address bits 
1-6. Counter 742 can be incremented under control of 
controller 700 to allow successive data words to be 
transferred over the external bus. The daU words to be 
sent to the computer system are assembled by the mod- 



flow buffer is scanned to determine any bytes contain- 40 ule address bus multiplexer 838 (FIG. 8). In particular, 
ing the most signficant bit set As described above, the multiplexer 838 is controlled by sequencer 700 and 
corresponding bytes in the data overflow buffer contain decoder 844 to place bits 1-21 of the local address bus 
the overflowed write data. (obtained from bus 835) and bite 8-15 of the local data 

A cache flush is fust performed on the appropriate bus 806 (obtained from bus 636) onto bus 839 in the 
data space (user or supervisor) to make room for the 45 format shown in FIQ. 9, line B3. From bus 839 the 
overflowed data. Next, the virtual addresses for the mformatiao is provided over enabled dri^ 850 to shuf- 
overflowed data must be constructed for each over- flc bus 856. From bus 856 the external information is 
flowed block. The reconstruction is done for each block provided to latch 866 by way of driver 858 and bus 864. 
by using as bits 15-23 of the the reconstructed address The information is latched into latch 866 and subae- 
the label information stored in the block status memory 30 quently forwarded to the remaittder of the system over 
for each block. Bits 8-14 of the reconstructed addresses bus 870 under control of the external sequencer as pre- 
arc provided from the information stored in each ad- viously described. Sequencer 700 remains in sobstate 
dress overflow buffer location previously identified as El, as shown in line EIQ until the informatkm has been 
having its most signficant bit set. Bits 0^ are deter- transferred at which point, as shown in line EID of state 
mined by the locations m the overflow buffer which 55 El, sequencer 700 jumps to state SI and performs a 
hold the information and bit 7 is determined by the special address acknowledge as previously described, 
overflow buffer involved (either 0 or 1). FUtah State 

After the address information has been reconstructed, 
the cache blocks indicated by bits 8-14 of the recon- The actiom taken during a flush of infonnatioa from 
strvctcd addresses are saved by moving them to another 60 the cache address memory 738 into main memory are 
available block m cache. shown in Table V and consists of seven sub-states 

The reconstructed addresses are then used to access F1-F7. As previously explained, the fluch circuitry 
main memory via the memory management circuitry as allows the processing element to transfer the contents of 
previously described in order to bring the affected data the cadie memory into system main memory when a 
blocks into cache. These blocks are then modified in 63 clearing of the cache memory b necessary at a context 
accordance with the data stored in the data overflow switch. In particular, the dicuitry is arranged so that 
buffers and the modified blocks are flushed back to main the flnshing or storing operation is initiated by a single 
memory. processor command and continues between limits set by 
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the processor. While the flush operation is underway no 
intervention from MPU 703 is necessary. Grcuitry used 
during a flush operation consists of multipleicr 720 and 
flush destination counter 718. As previously described, 
the flushing circuitry automaticaUy flushes all dirty 
blocks found in a spedfied range of addresses. 

TABLE V 
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STATE NAME ACTION 



CONDITIONS 



FLUSH (F) 












PI A. 


Load Rtsb Addrets 


Unoondaional on Exh 


FIB. 


Jump lo nue Fl 


UoconditiaBa] 


JF2L 




F2A. 


Enable Flush Addrm 


U DoooditioQal 




loCAfi 




F2B. 


Eoable BS Label 


BB* 




toKfM 




F2C. 


LucfaCAB to cache 


BB 




tad BS Label to MM 




F2D. 


Jomp to itKte PZ 


D and BB 


F2E. 


Jump to state F3 


CL* and D ynd 






T* and BB* 




fiijiiji *f J 

ivnup wo naie 


J and I 


F2G. 


Jstnp to Bate P5 


(CL or O*) fwl. T 


F2H. 


Jump to state F6 


CI.* airf D and 






T and BB« 








F3A. 


Pfff^4f Fwimiat 






Sequencer 


Entry 


F3B. 


Raise WE to BS Mem 


UDOOnditiooal on 






tntry 


TJV 
rj%^ 


KeiaiQ riuso Aoar. 






lo ^— AtJ 




F3D. 


1 jTrn i_Ari to cacDe 


T 111 ii-t!!! 1 




and R5; In MM 




r j£. 


Lower w t to 


^ MrvvTi1iiTliiI*P * 




DC L#MH 

dS Mem 






Add IZe to rltlin 






Address 




F3G. 


Jimp to state F2 




fF4) 
^^^^^ 








Ratae wt to o5 Mem 


UocoBOitiofia] on 






Entry 




Dm»mm m^^^k AaA^ia 
Kenun rtnso Aoor. 


UoooDditiona] 




to CAU 




F4C 


Latch CAB to cache 


BB 




and BS Label to MM 




F4D. 


Add ]28toFlwfa 


Unoooditiooal on Exit 




Aoorets 




F4E. 




unoooaiMfiu on cut 








P4P. 


Ju^^^ to s^aie P2 


UOOOOdttlOUl 


(FS) 






F5A. 


Latch CAB to cache 


BB 




and BS Label lo MM 




Fsa 


Raise WE to BS Mem 


Uacoodnioflal on 


FJC 




Entry 


Lower WE to 


Unoooditiooa] oo Exti 




BS Mem 




F3D. 


Jump to state P7 


UnoondttKBttl 


fFft 






FfiA. 


^^Qable ^^steioal 






Seijiicnoer 


Entry 


F6B. 


Latch CAB to cache 


BB 




and BS Label to MM 




FfiC 


Raise WE to BS Mem 








Eatry 


F6D. 


Lower WE to 






BSMem 




F6E. 


Jomp to state F7 


Uocooditional 






P7A- 


Latch CAB to cache 


BB 




and BS Label to MM 




F7B. 


Jump to state F7 


BB 


F7C 


Jmnptoftate SI 


BB* 
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In flush state Fl, line FIA, the starting flush cache 
address is loaded into flush destination counter 718. In 



particular, sequencer 700 controls multiplexer 720 to 
transfer bits 5-14 of the local address bus 730 into the 
load ports of the flush destination counter 718. During 
a cache flushing operation MPU 702 generates address 
signals with a format shown in Ime Gl of FIG. 9. In 
particular, bits O07-C16 are used to indicate the block 
at which to begin an automatic flush operation. Bits 1, 2 
and 3 generated on the local address bus are control bits 
used to control the operati<m of the flushing circuitry. 
In particular, bit CLR is an "auto-clear^ bit which, 
when set, indicates that a flush is not to be performed 
but rather that the block status memory locations in the 
address range spedfled is to have all valid and dirty bits 
cleared as specified by the CXT and F/S bits. Bit CXT 
is a context switch bit which indicates that the flush is 
being done as part of a context switch. If the flush is 
being done as part of a context switch the valid bit in the 
block status memory will be cleared, flush. If the flush 
is not being done as part of a context switch, the valid 
bit remains s^ (CXT^**!** indicates the flush is part of 
a context switch). The F/S bit decenmoes whether a 
flrst or second flush a being p er f o r med oa a given data 
block or address range. If the flush is a first flush the 
dirty bit will remain set, if it b a second flush the dirty 
bit wiU be cleared (F/S="0" for first flush). 

In addition to placing the starting address on the local 
address bus, MPU 702 also places a termination address 
on local data bus 732, as shown in line 02 in FIG. 9. In 
particular, termination bits T0T-T16 specify the cache 
address at which to terminate the automatic flushing 
operation. Therefore, the automatic flushing operation 
will flush all dirty blocks of cache between address 
O07-C16 (generated on the local address bus) and ad- 
33 dress Ta7-T16 (generated on the local data bus). 

The termination address information is also provided 
from local data bus 732 to sequence controller 700 
where it is compared to the output of flush destination 
counter 718 which is provided to sequencer 700 over 
^ bus 715. When the addresses are identical sequencer 700 
dtsoontinues the automatic flushing operatioiL 

As shown in sute F2, line F2A, sequencer 700 then 
places the flush address generated by counter 718 on 
cache address bus 737 by controlling multq>lexer 726. 
The output of multiplexer 726 is provided to latch 734 
to allow the cache address to be temporarily stored if 
the external bus mechanism is busy. The temporary 
storing allows the flush c ir c uitry to prqnre the next 
flush address while waiting for the externa] bus to be- 
come free. The flush address is also provided to block 
status memory 736 to obtain the status information 
stored therein. The output of memory 736 b also pro- 
vided via buses 747 and 745 to latch 754 which tempo- 
rariiy stores the status information if the external bus b 
busy. 

After providing the starting flush address to the ap- 
propriate memories, the subsequent operations of se- 
quencer 700 d^wnd on whether the operation b a clear 

^ operation or a normal flush operetioo as tndicratcd by 
the status of the clear bit in the address information oo 
the local address bus and whether the flush termination 
address has been reached as indicated by a match of the 
flush termination address on the local data bus to the 

63 output of the flush destination counter 7ia Before actu- 
ally performing the transfer of data to the main memory 
sequencer 700 checks the status of the dirty bit obtained 
from the block status memory. 
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As shown in line FID of flush substate F3, the se- 
quencer remftim in substate F2 if the block to be flushed 
IS dirty and the extonal bus is busy. Assuming that the 
operation is not a clear operation and the flush address 
has not been terminated, when the external bus becomes S 
free as shown in line F3E of flush subsute 2, flush sub- 
state 3 is entered. In flush substate 3 the information to 
be flushed is transferred to the main memory. 

The address in main memory into which the cache 
information is to be written is provided by the module 10 
address bus multiplexer 838. In particular, for a flush of 
user data, the high order bits 13-31 of the address are 
provided by the output of the user map RAM 814 
(UMAP bits U-31). Bitt 7-11 of the address are pro- 
vided to multiplexer 838 from flush destination counter IS 
718 via cache address multiplexer 726. cache address 
bus 737 (bits 7-11) and bus 840. The remaining tnts are 
control bits provided by a pattern generator over bus 
841 



ing to flush substate F4. In line F4A of flush substate F4. 
the WE to block status memory 736 is raised. This is 
done to enable the dirty and valid bits to be cleared as 
appropriate. In particular, in lines and F4C. the 
flush address is retained and latched to the cache mem- 
ory and the block status memory is latched to the mem- 
ory management unit (if the external bus is busy). Since 
the external sequencer is not enabled, however, the 
information in the non-dirty block is not transferred into 
mam memory thereby saving a memory cycle. In line 
F4D of flush state F4. the flush address is again incre- 
mented; in line F4E the WE lead is lowered to block 
status memory 726 and. in line F4F, sequencer 700 re- 
turns to flush substate FX 

Altenuuively. if a non-dirty block is encountered 
when the flush termination address is reached (or if the 
system is proceeding in the clear mode when the flush 
termination address is reached) as shown in line F2G of 
flush substate F2, the system proceeds with HvA sub- 



The virtual address used to access the user map RAM 20 state F5. In this case, as shown in Ime F5A. the flush 



is itself constructed from the flush drstinstirm address 
and block sUtus label information. Specifically, the 
block status label information is provided from block 
status memory 736 over buses 802 and 803 to user map 



address and block status label are latched to cache ad- 
dress bus and the memory management unit if the exter- 
nal bus is busy. In Une FSB, the WE lead to the block 
status memory is raised in order to dear the dirty and 



address multiplexer 810. The remainder of the informa- 25 invalid bits, as appropriate. In line F5C the WE lead is 
tion used to access map RAM 814 is provided from the ■ • • ■ . - -^ 

flush destination counter 718 over the cache address bus 
737 and bus 805 (bits 12-14 of the cache address bus). 
In the case of mappable supervisor data, the high- 



lowered, completing the clearing operation 

In line F5D, sequencer 700 jumps to flush subsute F7 
in which the flush destination address on the cache 
address bus and the block status label are latched to the 



order bits (bits 12-31) are provided to multiplexer 838 30 cache memory and memory m a na g em ent unit, respec- 



from the supervisor map register 824 over bus 828 
(SMAP bits 12-31). Bits 7-11 of the address are pro- 
vided from the flush destination counter over the path 
previously described, and the remaining bits are coded 
pattern bits. 

For unmappable supervisor data, bits 14-23 of the 
address are generated by bits 14-23 of the block status 
labd provided from the output of block status memory 
736 over bus 802 to multiplexer 838. Bits 7-13 of the 



tivdy (if the external bus b busy). As shown in line F7A 
of flush subsute F7, the system remains tn this state 
until, as shown in line F7B, the external bus becomes 
non-^y at which point the system jumps to special 
33 address acknowledge state Si to indicate to MFU 702 
that the flush operation is complete (as shown in line 
F7C of flush substate F7). 

Finally, if during a normal flush operation the system 
reaches the termination flush address and the external 



address are provided from bus 840 from the cache ad- 40 bus is not busy and the last bkxdc to be flushed is dirty. 
dress bus and the remaining bits are set to "O^s. The as showm inline F2H of flush state F2, the system jumps 
address information generated by multiplexer 838 is to flush substate F6 in which, as shown hi line F6A, the 
forwarded to the external bus over a path previously external s eq u e n cer is enabled in order to transfer the 
described. fio&l block to be flushed to the main memory. If the 

After a dau transfer has taken place, the flush address 43 external bus is busy, the flush address and oorxespond- 



is incremented to b^in another flush cycle. In sUte 
F3A the external sequencer is enabled in order to begin 
transfer of the flush data to main memory. In line FSB. 
the WE lead to block status memory 736 is raised in 



tng block status label are latched for temporary storage 
until the bus becomes not busy, as previously described. 
Next, as shown in line F6B, the dirty and valid bits 
stored in the block status memory are cleared as appro- 



order to clear the dirty and/or valid bits, as appropriate, 50 priate. Subsequently, the memory enibles are lowered 



in the block status memory associated with the block 
which has just been flushed to main memory. 

In lines F3C and F3D. the flush address present at the 
output of flush destination counter 718 is retained on the 
cache address bus and the flush address information and 55 
block SUtus label at the output of the block sutos mem- 
ory is latched in latches 734 and 754. respectively. In 
line F3E. the WE lead is lowered to the block sUtus 
memory and. in line F3F. sequencer 700 causes flush 

address counter 718 to increment to provide the next 60 ory 738 to another area under control of sequencer TOO. 



(lines F6C and F6D) and the system pr oceed s to sub- 
state F7 at the end of which it enters the acknowledge 
state SI to signal to MPU 702 that the flush operation 
has been completed. 

Move State 

The final cache operation which will be described in 
detail is a move opasiion in which dau already stored 
in cache memory 738 is moved from one area of mem- 



flush address. Sequencer 700 then returns to flush sub* 
state F2 (line F3C). 

Operation continues in this manner and dirty blocks 
are flushed to main menuny until the termination flush 



As previously explained, thb type of move is often 
necessary during certain processng opentiaos. for ex- 
ample, an I/O access opemkm which requires daU to 
be moved between the BI^)erviaor and the user dau 



address is reached. When a non-dirty block is enoonn- 65 areas of cache nwnory, respectively. The substeps in 



tered before the flush termination address is reached (or 
the system is in the clear mode) then processing contin- 
ues as shown in line F2F of flush substate F2 by jump- 



the move operatilm are diown in Table VI and consist 
of move subsutes M1-M6. The co r re sp o n ding hard- 
ware which performs the move operation is shown in 
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FIG. 7 and coosists of move register 706, move latch 
710, multiplexer 708, source address counters 728 and 
746, destination address counters 718 and 744 and multi- 
plexer 740. 

TABLE VI 



38 

TABLE Vl-continued 



STATE NAME ACTION 



CONDITION 



STATE NAME ACTION 



CONDITION 



MOVEfM) 
(Ml) 
MIA. 

MIB. 

MIC. 



MID. 

MIE. 
fM21 
M2A. 

M2B. 

M2C. 
M2D. 

M2E. 

M2F. 
M2G. 

Mm 

M21. 
M2J. 
M2K. 
tM3) 
M3A. 

M3B. 

M3C. 
M3D. 

M3E. 

M3F. 

M3G. 
M3H. 

M3I. 
M3J. 

M3K. 
MSI- 
fM4) 
M4A. 

M4B. 

M4C 
M4D. 

M4E 

M4F. 
<M5) 
MSA. 

MSB. 



M5C. 
MSD. 

MSB. 

M5F. 
M50. 
M5H. 



Load desttosiioQ 
Addm Regbtcr 
Enable Source 
Addrea to CAB 
Set CicheR/W - 
Rod 

Riiae MS and L5 byte 
CE to cube 
Jomp to lUte M2 



UDCOoditiOQal on Exit 



Uncoodttional 



Uncooditiootl 
Unooodtfwinul 



Uaoooditiooa} 



Diable MPU driver 
loLDB 

Retain Scarce Add. 
Enable to CAB 
Enatde SDB to LDfi 
Retain Cache R/W . 
Read 

Retain MS and L5 byte Uocoodttioaal 
CE to cacbe 
dock Move Rcgbler 
Lxtwer CE to cache 



U noooditkiiial 

Unoooditional 
Unconditional 



Add 3 toSontce 
Addtett 

Jump to ttate M3 
Jamp to state M4 
Jomp to itate M6 

Keep MPU driver to 
LOB disabled 
Eaabk Destination 
Address to CAB 
EaaUe LDB to SDB 
Set Cache R/W « 
Write 

Rksc LS byte CE to 
Cache 

Raiac WE to 
BS Meniary 
Lower CE to cache 
Lower WE to 
BS Mem 

Add 2 to DesL Addr. 
Sub I from 
Byte Coum 
Jump to Itate M4 
Jump to Itate SI 

ILeep MPU driver to 
LDBdiaahled 
EoaUe Source 
Address to CAB 
Enable SDB to LDB 
Set Cache R/W 
Read 

Raise MS and LS byte 
CE to cache 
JuB^ to state MS 

Keep MPU driven to 
LDB disabled 
RetaiD Source 
Address Enable 
to CAB 

Enable DSB to LOB 
Retain Cache R/W « 
Read 

Retain MS and 
LS byte CE to cacbe 
Clod MoveRegitter 
Lower CE to cache 
Add 2 to Source 
Addr. 



Uocooditiona] on Exit 
UiKOoditioaal on Eaii 
CM* on Exit 



DO 

SO and DO* 
SO and DO* 

Unconditional 

Unconditional 

Unoondttiona] 
UpoonJirtOTtal 

Falling edse of clock 



Ua 
fsl H*i j cdse 
Uocfioditiaaal on Exit 
Uncondiliooal oo Exit 

U n ooo di tiooal on Exit 
Uocooditiona] oa Exit 

B or CO 
B* orCO 

Uooonditiooal 

Uncoodhioaal 

UnooMiitiooal 
UiKondiiiwtal 

Uncood iiional 

^Jnoofldiitfti^sl 

Uoooodiiiona] 

Uncood itwtial 



Un co nd it ioDal 
Unoondttknal 

Unconditional 

Unconditional on Exit 
Unco ndit i on al oo Exit 
CM* oo Ezil 
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MSI. 

M6A. 

M6B. 

M6C 
M£D. 

M6E. 

M6F. 



M6G. 



M6H. 
MM. 



M6K. 



M6I_ 



M6M. 
M6N. 



Jump to state M6 

Keep MPU difven to 
U>B disabled 
Enable Dcsaaatioa 
Address to CAB 
Eeabk LOB to SDB 
Set Cacbe R/W 
Write 

Raise MS byteCE 
to Cacbe 

Raise LS byte CE 
to cacbe 

Raise WE to 
BS Memory 
Lower CE to cache 
Lower WE to 
BSMem 

Add 2 to DesL Addr. 
Std> 2 froo) 
ByicCoonl 
RfrcnaUeMPU 
driven to LDB 
Jamp to stale M4 
Jump to state SI 



Unoooditiooal 

^ TfT^ ^ ff H^itfTmsl 

Uncondftio^tfl 

Unoooditiooal 
Un c o n d tli o ti al — 

^Joooodtbooa] 

Falling edge of 
dock if nxnc than 1 
byte left 

Unoootfitiooal oo 
(ailing edge 
Uo c oodttiooal on Exit 
Unoooditiooal oo Exit 

U noondii w o a l on Exit 
U n eon diti o oa ] oo Exit 

B*ooExtt 

B 
B* 



A move operation is initiated by MPU 702. However, 
once the move operation is initiated, sequence control* 
ler 700 operates independently of MPU 702 to perform 

30 the move operation starting at a specified staxting ad- 
dress and continuing until a specified destination ad- 
dress is reached. During the time the move operation is 
being carried out by sequence controller 700, MPU 7Q2 
may be used for other tasks thus increasing the eRt- 

35 ciency of the system. A move operation has two mode- 
s—a ''nonnal" mode in which bytes or words arc 
moved from sequential memory locations to sequential 
destination addresses and a ''constant" mode in which 
the source address is not incremented so that the same 

40 word is moved to several destination locations. 

As shown on Table VI, the move ^leration begins on 
line MIA when MPU 702 loads the destination address 
into the destination address register. In particuUr, smoe 
a move operation may be carried om to the byte level 

45 a full seventcen-bit address must be provided to cache 
memory 738. MPU 702 places the 16-bit I^Bs of the 
destination address on its data leads which address is 
driven by drivers 716 onto local data bus 732. 
The format of the address placed on the internal data 

50 bus is shown in FIO. 9. line E2. Bits O00-C15 are the 
source address bits. FIG. 9, line E4 shows the corre- 
sponding data fonnat for a destination address (bits 
C00-C15 are the destination address bits). For the 
source address MPU 702 |daoes a special code on the 

55 local address bus as shown in FIG. 9, line El. Bits A23 
and A22s"P indicate that the addbress is an internal 
speaai address. Bits BO0-BC6 specify the block coimt 
equal to one less than the number of bytes to be moved. 
Bit S16 is the most significant bit of the source address. 

60 A similar code is placed on the local address bus at the 
time when the destination address is placed on the local 
data bus as shown in FIO. 9, line E3. In particular, bit 
CM, when set* indicates that the move operation is a 
constant mode operation. Bit D16 u the most significant 

65 bit of the destination address. 

Bits 1-6 of the destinatioD address are loaded mto 
counter 744 from local data bus 732. Bits 7-15 of the 
local data bus are provided to multiplexer 720 which b 
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controlled by sequencer 700 to load flush/move dcsti- is the LS byte, therefore, the first move operation wnles 
nation counter 718. on*y ^ LS byte which is stored in move register 706. 

Next, the move source address is placed by MPU 702. In particular, as shown in move substate M3, Unc 
via driven 716, on local data bus 732 and loaded into M3A, MPU drivers 716 remain disabled to separate the 
move source address counters 728 (hits 7-15) and 746 3 local data bus 732 from MPU 702. As shown in Knc 
(bits 1-6), By controlling multiplexer 726. sequencer M2B, the destination address is maintained to the cache 
700 can place either the output of counter 718 or address bus 737, as previously described. Sequencer 700 
counter 728 on bits 7-15 of the cache address bus 737. now sets up a path from local data bus 732 to shuflk 
Similarly, by controlling multq>lexer 749. sequencer 700 data bus 856 to cnabk transfer of information from the 
can place the output of either counter 744 or 746 on bits 10 move register 706 over local data bus 732 into cache 
1-6 of cache address bus 737. memory 738 (line M3C). This path is set up by cnablmg 

As shown in line MlB, sequencer 700 Grst controls drivers 852 and 854. Next, sequencer 700 sets the read/- 
address multiplexer 726 and multiplexer 740 to place the write control of cache memory 738 to write and enables 
source address from counter 728, via latch 734, and the LS byte ofthe cache memory (UnesM3D and M3E) 
counter 746 on cache address bus 737. Sequencer 700 15 thereby writing the LS byte into the LS byte of the 
then places cache memory 738 into a read condition and destination location. In addition, the WE lead to the 
enables the memory, as shown in lines MlC and MID block status memory 736 is also asserted to enable the 
and jumps to substate M2, as shown in line MIE. dirty and valid bits to be written into the block status 

Cache Memory 738 is arranged to store 16-bit words memory, 
arranged in two bytes (a most significant (MS) byte and 20 After the information has been written in both memo- 
a least significant (LS) byte). The internal connections ries the enables are lowered (line M3G and M3H) and 
of the memory are such that either or both bytes may be the destination address is mcremented by 2 (by incre- 
eoabled by means ofthe MS and LS menmry enables. menting counters 718 and 744, line M3I). The byte 

In substate M2, sequencer 700 controls the move counter (not shown) b decremented by 1 indicating that 
circuitry to move a first byte into move register 706. In 25 one byte has been transferred. 

particular, as shown in line M2A, sequencer 700 first Sequencer 700 next checks thecount remaining in the 
disables driven 716 to disconnect MPU 702 from local byte counter to ascertain if there is more than one byte 
data bus 732. As shown in line M2B, cache address remaining. If so, it proceeds to substate M4 in which 
multiplexer 726 is then controlled to retain the move another word is read into move register 706. If the 
source address to cache memory 738. Sequencer 700 30 move operation has been completed (as indicated by 
next enables a path from the output of cache memory less than one byte remaining) then sequenc er 700 pro- 
738 to local data bus 732 (fine M2C). In particular, cecds, as shown in line M3U to the special ackoowl- 
sequenoer 700 enables driven 748 to place the output of edge state SI which acknowledges to MPU 702 that the 
cache memory 738 onto local daU bus 732. The read move operation has been completed, 
and enable signals are retained to cache memory 738 3S Asstuning that more than one byte remains, in sub- 
(lines M2D and M2E) and the information in the least state M4, line M4A, driven 716 are kept disabl ed to 
significant (LS) byte is transferred to the local data bus. prevent interference with the move operation from 

The information on the local data bus is then trans- MPU 702. The source address is agam enabled to the 
fcrred into the move dicuitry. The operation of the cache address bus, as shown in line M4B. by controlling 
move circuitry is conditioned on whether the source 40 multiplexen 726 and 740 (b a previous state oounten 
address and termination address are word-aligned. 728 and 746 were incremented so that a new source 
Alignment is. in turn, determined by comparing bits 0 of address has been provided to cache address bus 737). 
the source and termination addresses. This comparison In line M4C. sequencer 700 again re-enaUcs the path 
is carried out in comparator 745. the output of which is from cache memory 738 ou^t to the local data bus to 
used to control multiplexer 708. If the source and desti- 43 allow information provided on the output of cache 
nation addresses are word-aligned (bits 0 are equal) then RAM 738 to be forwarded to register 706. In Une M4D 
the entire word on local data bus 732 b transferred the read/write control of cache memory 738 is set to 
through multiplexer 708 into register 706. If the ad- "read". Sequencer 700 next eoabfct both the LS and MS 
dresses are not word-aligned then the LS byte is stored bytes of the cache memory 738 (line M4E) thus writing 
in latch 710 and the MS byte becomes the LS byte ofthe 50 both the MS and LS bytes of the word into move regis- 
word stored in register 706. Therefore, the word stored ter 706 and/or move latch 710 depending on whether 
m register 706 has its MS byte equal to the LS byte of the words are word aligned or not Sequencer 700 then 
the previously moved word and its LS byte equal to the proceeds to sub-atate M5 (Uoe M4F). 
MS byte of the next word to be moved. Substate M5 completes the reading of the word into 

Assuming for the moment that the source and desti- 33 move register 706 and/or move latcA 710. In particular, 
nation addresses are word-aligned or there is only one as shown in lines M5A-M5E read oonditioQs are main- 
byte to be moved, move multiplexer 708 simply gates tained on cache memory 738. As sbown in Une M5F, 
the data on local data bus 732 into move register 706. move register 706 is then clocked to read in the informa- 
Next. as shown in line M2G. the cnaUe signal is low- tion. The cache memory is then disabled and the source 
cied to cache memory 738 thus disabling it As shown b «0 address connten 728 and 746 are incremented, as shown 
Une M2H, the source address register 728 is then incre- b lines M5G and M5H. The sequencer then proceeds to 
mentcd by 2 assuming that the cache move is not a substate M6 (line MSI). 

constant mode move. In substate M6. the entire word stored m word regis- 

Next as shown in substate M2 (lines M2I, M2J and ter 706 is then written bto the cache memory unless 
M2K), sequencer 700 makes a decision to proceed based 63 there is only one byte to moved m which case only the 
on whether or not the move is word-aligned or not As most significant (MS) byte b moved. In particular, as 
shown m state M2I, if bit 0 of the destination address is sbown m Une M6A. driven 716 remam disabled. In Ime 
equal to 1 this indicates that the first byte to be moved M6B. sequencer 700 places the move destination ad- 
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dress on cache address bus 737 by enabling multiplexer 
726 to provide the destination address stored in counter 
718 to the cache address bus 737 and by enabling multi- 
plexer 740 to provide the remainder of the destination 
address stored in counter 744 to bus 737. 5 

As slu>wn in line M6C the path from local data bus 
806 to shuffle data bus 856 is enabled by enabling driv- 
ers 852 and 854 so that information can be transferred 
from move register 706 to the data inputs of cache mem- 
ory 738. The cache memory is set into the write oondi- 10 
tion (line M6D) and the enable signal is raised to the 
most significant byte (M6E) writing the MS byte of the 
word stored in move register 706 into cache RAM 738. 
If there is more than one byte left, as shown in line M6F, 
the LS byte stored in move register 706 is also written 13 
into cache memory 738. In addition, as shown in line 
M6G, the dirty and valid bits in the block sutus mem- 
ory arc also updated when sequencer 700 asserts the 
WE lead to memory 736. 

Subsequently, the enables are lowered to the memo- 20 
ries Oines MiH and M6I). In line M6J, destinatitm 
counters 718 are 744 are increased by 2 to set them up 
for the next destination and, in Une M6K. the byte 
counter is decremented by 2 turiicnring that two bytes 
have been transferred from move register 706 into 23 
cache memory 738. 

Finally, as shown in line M6L. drivers 716 are re-ena- 
bled to connect MPU 702 to the local data bus 732 in 
preparation for completion of the move operation. If, 
however, there are more than two bytes remaining to be 30 
transferred, as shown in line M6M, then sequencer 700 
jumps to substate M4 and begins the transfer operation 
once again. If there are less than two bytes remaining to 
be transferred as shown in line M6N the sequencer 
jumps to acknowledge state SI which indicates to MPU 35 
702 that the move operation has been completed. 

Although only one illustrative embodiment of the 
invention has been described herein other changes and 
modiitcations will be apinrent to those skilled in the art 
which changes and modifications are within the spirit 40 
and scope of the invention and are mtended to be cov- 
ered by the claims herein. 

What is claimed is: 

1. Memory backup apparatus for a fault-tolerant com- 
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said temporary storage area into said first memory 
area when said temporary storage area is full or 
when said task control signals indicate a context 
switch is requested, said second means producing a 
completion signal when said writing hu been com- 
pleted; 

third means re^xmsive to said completion signal and 
to said fault signals for writing said selected por- 
tions of said temporary storage area into said sec- 
ond memory area when the writing of data from 
said temporary storage area into said first memory 
area has been completed without a fauh condition 
being detected^ 
a backup status register and means connected to said 
second and said third writing means for updating 
backup status information stored in said backup 
status register, said backup status information iden- 
tifying memory areas which have been written 
ftom said temporary storage area, wlwrein said 
second writing means generates a start signal at the 
beginning of a storage operation to said Gnt 
ory area and said updating means is re sp o nsi ve to 
said start signal for updating said backup status 
register and a req>onsive to said completic»i signal 
for updating said backup status register; 
means responsive to said backup status information 
for restarting a data processing task "tiHring said 
initial data stored in said first memory area if a 
system failure has occurred before the >*«y""ttTg of 
a storage operation from said temporary storage 
area to said first memory area; and 
means responsive to said backup status infonnatian 
for writing the contents of said second memory 
area into said first memory area and restarting the 
data processing task using data stored in said sec- 
ond memory area if a system failure has occurred 
after the begtuiing of a storage operation from said 
temporary memory to said first memory area but 
before said storage operation has been completed. 
2. Memory backup ^iparatus in accordance with 
claim 1 wherein said third writing means generates a 
second start signal at the beginning of a storage open* 
tion to said secoiKl memory area and a second comple- 
tion signal after the storage operation to said second 



puter system having system monories for storing data, a 43 memory area has been completed and said updating 



processing element for performing a plurality of data 
processing tasks and computations, said processing cle- 
ment generatiag write control signals to cause informa- 
tion to be written into said system memories and task 
control signals for controlling said system during a JO 
context switch, and means for monitoring fault occur- 
rences in said computer system and for generating fiuilt 
signals, said backup apparatus co mprisin g, 
a first memory area and a second, physically sqorate 



means is re^KXtsive to said second start signal for updat- 
ing said badnip status register and is r e sp oa ai ve to said 
second ooo^iletton signal for updating said backup sta- 
tus register. 

3. Memory backup apparatus in accordance with 
claim 2 further COTiprising means rcspcMxsive to said 
backup status infonnation for writing the contents of 
said first memory area into another one of said memory 
areas and restarting the data processing task using data 
memory area located in said system memories, said 33 stored in said first memory area if a system faihue has 
memory areas storing duplicate copies of data and occurred before the beginning of a storage operation 
subsequent computational results generated by said from said temporary memory to said second memory 
processing element; area, 
a temporary storage area generating a fiiU signal 4. Memory backup apparatus in accordance with 
when a predetermined number of storage locations 60 claim 3 further comprising means responsive to said 
in said memory having been written to; backup status infonnation for writing the contents of 

first means responsive to said write signals for writing said firvt memory area into another one of said memory 
data from said first memory area into said tempo- areas and restarting the data processing task mang data 
rary storage area and for writing computational stored in said first memory area if a system failure has 
results produced by said processing element into 65 occurred after the beginning of a storage operation 
said temporary storage area; from said temporary memory to said second memory 

second means reqxmsive to said full signal and to said area but before said storage operation has been corn- 
task control signals for writing selected portions of pleted. 
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5. A method for t ffcVing up data in a fault-tolerant 
computer system having a first, a second and a third 
system memories for storing data, a processiDg element 
for performing a plurality of data processing casks and j 
computations, a status register and means for detecting 
the occurrence of a fault in said computer system* said 
ftrst and third system memories storing duplicate copies 
of data and si^nequent computational results generated 
by said processing element, said method comprising the 
steps of: 

A. during the processing of a task, writing data asso* 
dated with said task from said first memory into 
said second memory and writing computational is 
nsults produced by said processing element into 
said y^^wfi memory; 

B. detecting a context switch condition or a memory 
full condition in which a predetermined number of ^ 
memory locations have been written to; 

CI. after a context switch has been initiated or after a 
memory full condition has been detected copying 
selected porttons of said second memory into said 
first memory; 

C2. checking said fault detector to determine if a fault 
has been detected; 

C3. storing a first status code in said status register 
indicating that the copying of selected portions of 3q 
said second memory to said first memory has begun 
if no fault has been detected in step C2; 
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C4. dfttt^ting the completion of the copying of said 
selected portions of said second memory to said 
first menKMy; 

C5. checking said fault detector to determine if a fault 
has been detected; 

C6. storing a status code in said status re^stcr if no 
fault has been detected in step C3. sakS second 
status cxxle indicating that the copying selected 
portions of said second memory to said (mil mem- 
ory has been completed; 

Dl. copying said selected portions of said second 
memory into sakl third memory when the copying 
of data from said second memory into said fiisi 
memory has been completed without a fault condi- 
tion behig detected; 

D2. checking said status register to obtain the status 
code stored therein; 

D3. checking said fault detector to determine if a 
fault has been detected; 

D4. storing a third sUtos code in said regiider when 
said status code stored in said register is said second 
sutus code and no &ult has been detected in step 
D3. said third code indicating that copying of said 
selected portions of said second memory to said 
third memory has begun; 

E. restarting said system using data stored in said 
first memory if a fault is de tected in step C2; 

F. restarting said system using data stored in said 
third memory if a foult is detected in step C3; and 

G. restarting said system using data stored in said 
first memory if a Cault b detected in step D3. 

» • « • • 
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